amazon-kinesis-agent
amazon-kinesis-agent copied to clipboard
Please add ability to specify filePattern that includes all subdirectories
I may be doing this wrong, but the following does not work:
{
"cloudwatch.emitMetrics": false,
"flows": [
{
"filePattern": "/var/log/myapp/**/*log",
"deliveryStream": "myapp_logs"
}
]
}
I want to see logs /var/log/myapp/*log
and /var/log/myapp/subfolder/*log
and so forth to be sent to Firehose. This doesn't appear to work though.
There's even a TODO in the code: https://github.com/awslabs/amazon-kinesis-agent/blob/51c60e07b7f2069a1424aa651fa09a2b46fdc721/src/com/amazon/kinesis/streaming/agent/tailing/SourceFile.java#L47
Any update on this one? Also hit this case with some docker containers in /var/lib/docker/containers/<hash>/<hash>-json.log
and I was wondering why this pattern didn't seem to work: /var/lib/docker/containers/*/*-json.log