amazon-kinesis-agent
amazon-kinesis-agent copied to clipboard
awslabs
Continuously monitors a set of log files and sends new data to the Amazon Kinesis Stream and Amazon Kinesis Firehose in near-real-time.
Hello, We have a logstash pipeline writing log files per host, per day into a directory. Logstash pipeline's output portion looks like this; ``` output { file { path =>...
Logging this here for the sake of helping others, when running the Kinesis agent referenced in the documentation for Red Hat: https://docs.aws.amazon.com/streams/latest/dev/writing-with-agents.html#download-install You are directed to download v1 (1.1.6) of...
Currently, I am planning running two aws-kinesis-agent in the docker for sending data into two endpoints in different region. Thus, I am starting aws-kinesis-agent by using the executable file start-aws-kinesis-agent....
When running kinesis-agent into a container and using kubernetes service account integration with IAM Roles (https://docs.aws.amazon.com/eks/latest/userguide/iam-roles-for-service-accounts.html), kinesis-agent still tries to use the instance-profile of the running instance instead of the...
Though it may not be exploitable, the noise created by Snyk image scans which contain the agent would be very nice to fix. Name : com.fasterxml.jackson.dataformat:jackson-dataformat-cbor Version : 0:2.10.3 File...
*Issue #, if available:* #216 *Description of changes:* now via agent.conf you can add static fields to you event for example: ``` "dataProcessingOptions": [ { "optionName": "CSVTOJSON", "staticFields": { "host":...
[javac] An annotation processor threw an uncaught exception. [javac] Consult the following stack trace for details. [javac] java.lang.IllegalAccessError: class lombok.javac.apt.Processor (in unnamed module @0x50c9b080) cannot access class com.sun.tools.javac.processing.JavacProcessingEnvironment (in module...
Following on from #234, v2.0.5 is now the latest release of the kinesis agent but the RPM download link here https://s3.amazonaws.com/streaming-data-agent/aws-kinesis-agent-latest.amzn2.noarch.rpm bundles v2.0.4. When will this RPM be updated to...
I have followed the guide here http://docs.aws.amazon.com/firehose/latest/dev/writing-with-agents.html and setup the kinesis agent to sent data both from the /var/log/syslog log file and from an nginx log file (using the solution...
For cross compiling, it would be helpful to be able to run `./setup --build` as a non-root user. Right now, there is this code: ``` # Make sure only root...
