graylog-plugin-aws
graylog-plugin-aws copied to clipboard
Speed up reading of CloudTrail logs from SQS
trafficstars
Reading thousands of CloudTrail logs can be very slow. There must be a better way to read everything in batches, using their cursor functionality.
I'll also try to read from S3 in batches or multithreaded. This is where the bottleneck is now.