awsbeats
awsbeats copied to clipboard
Failed to get partition key
Can someone help me how to fix this error message?
2019-02-13T05:13:34.287Z DEBUG [kinesis] streams/client.go:114 failed to map event({{2019-02-13 05:13:30.925710489 +0000 UTC m=+0.052119993 null {"beat":{"hostname":"ip-xxxxxx.ec2.internal","name":"ip-xxxxxx.ec2.internal","version":"6.5.4"},"host":{"name":"ip-xxxxxx.ec2.internal"},"message":"Feb 10 03:47:01 ip-xxxxxx systemd: Removed slice User Slice of root.","meta":{"cloud":{"availability_zone":"us-east-1e","instance_id":"i-xxxxxxx","machine_type":"t2.large","provider":"ec2","region":"us-east-1"}},"offset":1215,"source":"/var/log/messages"} { false 0xc000337e10 /var/log/messages 1291 2019-02-13 05:13:30.923972221 +0000 UTC m=+0.050381713 -1ns log map[] 4321741-51713}} 1}): failed to get parititon key: failed to get parition key: key not found
Here's my configuration file:
`filebeat.prospectors:
- input_type: log
paths:
- /var/log/messages
document_type: syslog
processors:
- add_cloud_metadata:
output:
streams:
region: us-east-1
stream_name: system-log-stream
partition_key: testing1
queue.mem:
events: 4096
flush.min_events: 5
flush.timeout: 3s
I am getting the same thing, any help would be appreciated.
solved here https://github.com/s12v/awsbeats/issues/50#issuecomment-675690766