aws-vpc-flow-log-appender icon indicating copy to clipboard operation
aws-vpc-flow-log-appender copied to clipboard

Failing due to "body size too big"

Open Tirano2150 opened this issue 6 years ago • 9 comments

When working with larger networks the decorator fails due to the response "body size is too long" (response over 6MB).

I've observed this when decorating 11K + items

Tirano2150 avatar Aug 16 '17 10:08 Tirano2150

We are seeing the same thing when running this on our accounts. upload

tuxtek avatar Sep 14 '17 14:09 tuxtek

This error seems to be related to Lambda payload size. One option would be to try reducing the Amazon Kinesis Firehose ES Buffer Size and/or Interval, this should result in the payload being reduced. If you have an opportunity to test, please respond back.

jkahn117 avatar Sep 15 '17 17:09 jkahn117

@tuxtek Did your issue fixed ?? I am getting the same error...Please help me out.

irfan1124 avatar Sep 19 '17 09:09 irfan1124

I have been tied up firefighting and unable to get back to it yet. I will try it out by tomorrow and let you know. :)

tuxtek avatar Sep 19 '17 18:09 tuxtek

I had same issue couple of months and did the same [ set ES buffer size (MB) value to 1] and all the invocation errors stopped and flow logs works perfectly.

santhosh244 avatar Sep 20 '17 14:09 santhosh244

@Tirano2150 / @tuxtek : With your data you should also get an error on geographical data check which has per hour limitation. Even i had that issue and commented our the geo check function. if you see invocation errors check this as well.

santhosh244 avatar Sep 20 '17 15:09 santhosh244

I tried this solution but its not working . Please suggest

devsecops-reetika avatar May 04 '18 11:05 devsecops-reetika

I tried it too, it kind of works if things are really slow. But it doesn't seem to work otherwise. Spent several hours with aws on phone to no avail. Oh well.

symgryph avatar Jul 26 '18 22:07 symgryph

Upload response to S3 and return presigned S3 link to client

mojimi avatar Mar 08 '19 15:03 mojimi