amazon-kinesis-agent
amazon-kinesis-agent copied to clipboard
awslabs
Continuously monitors a set of log files and sends new data to the Amazon Kinesis Stream and Amazon Kinesis Firehose in near-real-time.
# Build/install of the kinesis agent fails on latest Debian (buster) I am trying to install the kinesis agent on debian10 which is using openjdk11 and the following error: ```bash...
In our application, kinesis agent is trying to read a file abc.log, at the same time, abc.log is rotated using logrotate with _**copytruncate**_ mode. After the file got rotated to...
Hi I am trying to install Amazon-Kinesis-Agent 1.1.2 on my RHEL 7.2. I have installed the following java version > openjdk version "1.8.0_111" > OpenJDK Runtime Environment (build 1.8.0_111-b15) >...
I've setup a Kinesis agent on EC2 instance having windows operating system. Its getting me the following error for multiple sinks I've specifiedin my appsetting file. This error occurs randomly....
It seems like theres an issue with the Kinesis Agent collecting events that were generated whilst the agent is not running, at least upon shutdown/startup of the machine. According to...
New access key for AWS Firehose was generated with AWS Management Console, the new key included a forward slash. After updating the config, Kinesis Agent continually threw this send error....
https://github.com/awslabs/amazon-kinesis-agent/blob/master/src/com/amazon/kinesis/streaming/agent/ByteBuffers.java#L53
支持文件夹的模式能支持类似/yyyy/mm/dd/xxx.log 这种形式的日志收集. 目前只能通过每天定期执行修改agent.json配置文件的内容定时重启agent的方式来实现了. https://github.com/awslabs/amazon-kinesis-agent/blob/51c60e07b7f2069a1424aa651fa09a2b46fdc721/src/com/amazon/kinesis/streaming/agent/tailing/SourceFile.java#L47
It looks like there are a bunch of configuration options here: https://github.com/awslabs/amazon-kinesis-agent/blob/master/tst/com/amazon/kinesis/streaming/agent/config/agentconfig1.json that aren't documented on GitHub or on the docs.aws.amazon.com pages for the Kinesis Agent. Could documentation be written...
For instance, if there is an env variable AWS_REGION, allow the following config to be valid: ``` { "cloudwatch.emitMetrics": true, "kinesis.endpoint": "kinesis.${AWS_REGION}.amazonaws.com", "firehose.endpoint": "firehose.${AWS_REGION}.amazonaws.com" ...etc } ```
