添加云资产信息

简介

processor_cloud_meta插件可以添加为日志增加云平台元数据信息。

版本

Alpha

配置参数

参数 类型 是否必选 说明
Metadata []string 是 增加元信息配置,，默认追加名字为元信息标签名，支持标签请参考支持元信息标签。
Platform String 否 云平台名称，目前支持 alibaba_cloud_ecs、auto，auto 模式支持动态选择云平台，默认值auto。
JSONPath String 否 为空时直接添加字段，不为空时表示为json序列化字段增加元数据标签，支持多层结构增加云平台元信息，最内层结构需要为json结构，如存在 Log_Content 结构a: {"b":{}}，当在 a 子结构下追加是JSONPath为a，当在 b 子结构下追加时JSONPath 为 a.b
RenameMetadata map[string]string 否 重命名Metadata名称
ReadOnce bool 否 true表示仅读取一次，不支持感知动态变化，默认值false。

支持元信息标签

标签 说明
__cloud_instance_id__ 云服务器实例id
__cloud_instance_name__ 云服务器实例名
__cloud_zone__ 云服务器实例zone
__cloud_region__ 云服务器实例region
__cloud_instance_type__ 云服务器实例规格
__cloud_vswitch_id__ 云服务器实例vswitch id
__cloud_vpc_id__ 云服务器实例vpcid
__cloud_image_id__ 云服务器实例镜像id
__cloud_max_ingress__ 云服务器实例最大内网入带宽
__cloud_max_egress__ 云服务器实例最大内网出带宽
__cloud_instance_tags__ 云服务器实例标签前缀，如配置 cloud_instance_tags：custom_tag ，当云实例存在标签a：b 时，将增加 custom_tag_a:b 数据

json Mode 配置举例

Data Input JSONPath Metadata RenameMetadata Data Output
A:{} "" ["cloud_zone"] {} A:{},"__cloud_zone__":"xxxx"
B:{} "A" ["cloud_zone"] {"cloud_zone":"zone"} B:{},A:{"zone":"xxxx"}
A:"" "A" ["cloud_zone"] {"cloud_zone":"zone"} 选中A字段，但A字段非json结构，因此跳过追加，输出A:""
A:{"a":{"b":{}}} "A.a.b" ["cloud_zone"] {"cloud_zone":"zone"} A:{"a":{"b":{"zone":"xxxx"}}}
A:{"a":{"b":{}}} "A.a.b.c" ["cloud_zone"] {"cloud_zone":"zone"} A:{"a":{"b":{c:{"zone":"xxxx"}}}}

样例

content 模式

  • 采集配置
enable: true
inputs:
  - Type: service_mock
    LogsPerSecond: 10
    MaxLogCount: 100
    Fields:
      content: "abc"
processors:
  - Type: processor_cloud_meta
    Platform: mock
    Mode: add_fields
    Metadata:
      - "__cloud_instance_id__"
      - "__cloud_instance_tags__"
    RenameMetadata:
      __cloud_instance_id__: instance_id_name
      __cloud_instance_tags__: instance_tag_prefix
flushers:
  - Type: flusher_stdout
    OnlyStdout: true
  • 输出
2023-03-13 20:42:04 {"content":"{\"a\":{\"b\":{}}}","Index":"1","instance_id_name":"id_xxx","instance_tag_prefix_tag_key":"tag_val","__time__":"1678711324"}
2023-03-13 20:42:04 {"content":"{\"a\":{\"b\":{}}}","Index":"2","instance_id_name":"id_xxx","instance_tag_prefix_tag_key":"tag_val","__time__":"1678711324"}
2023-03-13 20:42:04 {"content":"{\"a\":{\"b\":{}}}","Index":"3","instance_id_name":"id_xxx","instance_tag_prefix_tag_key":"tag_val","__time__":"1678711324"}
2023-03-13 20:42:04 {"content":"{\"a\":{\"b\":{}}}","Index":"4","instance_id_name":"id_xxx","instance_tag_prefix_tag_key":"tag_val","__time__":"1678711324"}
2023-03-13 20:42:04 {"content":"{\"a\":{\"b\":{}}}","Index":"5","instance_id_name":"id_xxx","instance_tag_prefix_tag_key":"tag_val","__time__":"1678711324"}
2023-03-13 20:42:04 {"content":"{\"a\":{\"b\":{}}}","Index":"6","instance_id_name":"id_xxx","instance_tag_prefix_tag_key":"tag_val","__time__":"1678711324"}
}

json 模式

  • 采集配置
enable: true
inputs:
  - Type: service_mock
    LogsPerSecond: 10
    MaxLogCount: 100
    Fields:
      content: "{\"a\":{\"b\":{}}}"
processors:
  - Type: processor_cloud_meta
    Platform: mock
    JSONPath: "content.a.b"
    Metadata:
      - "__cloud_instance_id__"
      - "__cloud_instance_tags__"
    RenameMetadata:
      __cloud_instance_id__: instance_id_name
      __cloud_instance_tags__: instance_tag_prefix
flushers:
  - Type: flusher_stdout
    OnlyStdout: true
  • 输出
2023-03-13 20:39:02 {"content":"{\"a\":{\"b\":{\"instance_id_name\":\"id_xxx\",\"instance_tag_prefix_tag_key\":\"tag_val\"}}}","Index":"1","__time__":"1678711142"}
2023-03-13 20:39:02 {"content":"{\"a\":{\"b\":{\"instance_id_name\":\"id_xxx\",\"instance_tag_prefix_tag_key\":\"tag_val\"}}}","Index":"2","__time__":"1678711142"}
2023-03-13 20:39:02 {"content":"{\"a\":{\"b\":{\"instance_id_name\":\"id_xxx\",\"instance_tag_prefix_tag_key\":\"tag_val\"}}}","Index":"3","__time__":"1678711142"}
2023-03-13 20:39:02 {"content":"{\"a\":{\"b\":{\"instance_id_name\":\"id_xxx\",\"instance_tag_prefix_tag_key\":\"tag_val\"}}}","Index":"4","__time__":"1678711142"}
2023-03-13 20:39:02 {"content":"{\"a\":{\"b\":{\"instance_id_name\":\"id_xxx\",\"instance_tag_prefix_tag_key\":\"tag_val\"}}}","Index":"5","__time__":"1678711142"}

results matching ""

    No results matching ""