amazon-kinesis-agent icon indicating copy to clipboard operation
amazon-kinesis-agent copied to clipboard

send some static columns (for example - host)

Open slmzig opened this issue 4 years ago • 1 comments

Business problem. In my case we have thousand of servers with files. In source files we have not got information about server name and we can not add it. And on the kinesis analytics side we need to know what server the event come from and make a decision based on this information. So it would be great to add serverName to the event. I need this feature in CSVTOJSON processor.

slmzig avatar Nov 03 '20 20:11 slmzig

hey @slmzig, please have a look at https://aws.amazon.com/premiumsupport/knowledge-center/kinesis-data-firehose-agent-ec2-metadata/ . there is an option for exporting ec2 metadata(privateIp, availabilityZone, instanceId, instanceType, accountId, amiId, region, and metadataTimestamp) along logs.

However not sure about adding "custom" static attribute in configuration like : service=myservice or team=myteam. Looking for it if there is a way to achieve it. Will update here accordingly if found something.

Kami1135 avatar Jan 27 '21 13:01 Kami1135