kube-eventer icon indicating copy to clipboard operation
kube-eventer copied to clipboard

Failed to export data to ElasticSearch sink

Open fengjie926 opened this issue 1 year ago • 0 comments

K8S Server v1.28.2

kube-eventer image: registry.aliyuncs.com/acs/kube-eventer:v1.2.7-ca03be0-aliyun

Elastic 版本: [阿里云 Elasticsearch Serverless服务] 入门版本7.10

spec: dnsPolicy: ClusterFirstWithHostNet serviceAccount: kube-eventer containers: - image: registry.aliyuncs.com/acs/kube-eventer:v1.2.7-ca03be0-aliyun name: kube-eventer command: - "/kube-eventer" - "--source=kubernetes:https://kubernetes.default" ## .e.g,dingtalk sink demo - --sink=elasticsearch:http://estest-hq1.public.cn-hangzhou.es-serverless.aliyuncs.com:9200?sniff=false&index=kubeeventer&esUserName=****&esUserSecret=****

看起来是 ES index 中部分字段不支持,能帮忙给出建议的 index 或如何解决

W1219 17:28:30.999337 1 driver.go:110] Failed to export data to ElasticSearch sink: elastic: Error 400 (Bad Request): Failed to parse mapping [_doc]: Root mapping definition has unsupported parameters: [default : {_all={enabled=false}}] [general : {properties={MetricsTags={properties={cluster_name={index=not_analyzed, type=string}, type={index=not_analyzed, type=string}, host_id={index=not_analyzed, type=string}, labels={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_name={type=string, fields={raw={index=not_analyzed, type=string}}}, pod_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, nodename={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, hostname={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_base_image={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_id={index=not_analyzed, type=string}, resource_id={index=not_analyzed, type=string}, pod_id={index=not_analyzed, type=string}}}, MetricsValue={properties={value={type=double}}}, GeneralMetricsTimestamp={format=strict_date_optional_time||epoch_millis, type=date}, MetricsName={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}}}] [memory : {properties={Metrics={properties={memory/request={properties={value={type=double}}}, memory/rss={properties={value={type=double}}}, memory/node_reservation={properties={value={type=double}}}, memory/node_capacity={properties={value={type=double}}}, memory/page_faults={properties={value={type=double}}}, memory/cache={properties={value={type=double}}}, memory/working_set={properties={value={type=double}}}, memory/usage={properties={value={type=double}}}, memory/limit={properties={value={type=double}}}, memory/node_allocatable={properties={value={type=double}}}, memory/major_page_faults_rate={properties={value={type=double}}}, memory/node_utilization={properties={value={type=double}}}, memory/page_faults_rate={properties={value={type=double}}}, memory/major_page_faults={properties={value={type=double}}}}}, MetricsTags={properties={cluster_name={index=not_analyzed, type=string}, type={index=not_analyzed, type=string}, host_id={index=not_analyzed, type=string}, labels={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_name={type=string, fields={raw={index=not_analyzed, type=string}}}, pod_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, nodename={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, hostname={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_base_image={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_id={index=not_analyzed, type=string}, resource_id={index=not_analyzed, type=string}, pod_id={index=not_analyzed, type=string}}}, MemoryMetricsTimestamp={format=strict_date_optional_time||epoch_millis, type=date}}}] [cpu : {properties={Metrics={properties={cpu/usage_rate={properties={value={type=double}}}, cpu/node_reservation={properties={value={type=double}}}, cpu/request={properties={value={type=double}}}, cpu/usage={properties={value={type=double}}}, cpu/node_utilization={properties={value={type=double}}}, cpu/node_allocatable={properties={value={type=double}}}, cpu/limit={properties={value={type=double}}}, cpu/node_capacity={properties={value={type=double}}}}}, CpuMetricsTimestamp={format=strict_date_optional_time||epoch_millis, type=date}, MetricsTags={properties={cluster_name={index=not_analyzed, type=string}, type={index=not_analyzed, type=string}, host_id={index=not_analyzed, type=string}, labels={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_name={type=string, fields={raw={index=not_analyzed, type=string}}}, pod_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, nodename={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, hostname={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_base_image={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_id={index=not_analyzed, type=string}, resource_id={index=not_analyzed, type=string}, pod_id={index=not_analyzed, type=string}}}}}] [filesystem : {properties={FilesystemMetricsTimestamp={format=strict_date_optional_time||epoch_millis, type=date}, Metrics={properties={filesystem/usage={properties={value={type=double}}}, filesystem/inodes={properties={value={type=double}}}, filesystem/inodes_free={properties={value={type=double}}}, filesystem/available={properties={value={type=double}}}, filesystem/limit={properties={value={type=double}}}}}, MetricsTags={properties={cluster_name={index=not_analyzed, type=string}, type={index=not_analyzed, type=string}, host_id={index=not_analyzed, type=string}, labels={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_name={type=string, fields={raw={index=not_analyzed, type=string}}}, pod_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, nodename={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, hostname={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_base_image={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_id={index=not_analyzed, type=string}, resource_id={index=not_analyzed, type=string}, pod_id={index=not_analyzed, type=string}}}}}] [events : {properties={EventTags={properties={eventID={index=not_analyzed, type=string}, cluster_name={index=not_analyzed, type=string}, hostname={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, pod_id={index=not_analyzed, type=string}, pod_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}}}, Type={index=not_analyzed, type=string}, Message={type=string, fields={raw={index=not_analyzed, type=string}}}, FirstOccurrenceTimestamp={format=strict_date_optional_time||epoch_millis, type=date}, Metadata={properties={uid={index=not_analyzed, type=string}, resourceVersion={index=not_analyzed, type=string}, creationTimestamp={format=strict_date_optional_time||epoch_millis, type=date}, name={type=string, fields={raw={index=not_analyzed, type=string}}}, namespace={type=string, fields={raw={index=not_analyzed, type=string}}}, selfLink={index=not_analyzed, type=string}}}, Count={type=long}, Reason={index=not_analyzed, type=string}, Source={properties={component={index=not_analyzed, type=string}, host={type=string, fields={raw={index=not_analyzed, type=string}}}}}, InvolvedObject={properties={uid={index=not_analyzed, type=string}, apiVersion={index=not_analyzed, type=string}, kind={index=not_analyzed, type=string}, resourceVersion={index=not_analyzed, type=string}, fieldPath={type=string, fields={raw={index=not_analyzed, type=string}}}, name={type=string, fields={raw={index=not_analyzed, type=string}}}, namespace={type=string, fields={raw={index=not_analyzed, type=string}}}}}, LastOccurrenceTimestamp={format=strict_date_optional_time||epoch_millis, type=date}}}] [network : {properties={NetworkMetricsTimestamp={format=strict_date_optional_time||epoch_millis, type=date}, Metrics={properties={network/tx_errors={properties={value={type=double}}}, network/tx_rate={properties={value={type=double}}}, network/rx={properties={value={type=double}}}, network/tx_errors_rate={properties={value={type=double}}}, network/rx_errors={properties={value={type=double}}}, network/rx_errors_rate={properties={value={type=double}}}, network/tx={properties={value={type=double}}}, network/rx_rate={properties={value={type=double}}}}}, MetricsTags={properties={cluster_name={index=not_analyzed, type=string}, type={index=not_analyzed, type=string}, host_id={index=not_analyzed, type=string}, labels={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_name={type=string, fields={raw={index=not_analyzed, type=string}}}, pod_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, nodename={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, hostname={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_base_image={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, container_name={index=analyzed, type=string, fields={raw={index=not_analyzed, type=string}}}, namespace_id={index=not_analyzed, type=string}, resource_id={index=not_analyzed, type=string}, pod_id={index=not_analyzed, type=string}}}}}] [type=mapper_parsing_exception]

fengjie926 avatar Dec 19 '23 08:12 fengjie926