logging-flume icon indicating copy to clipboard operation
logging-flume copied to clipboard

Fixes to address 2K message size limit when using SyslogUDPSource.

Open ryanpersaud opened this issue 8 years ago • 4 comments

Please see https://issues.apache.org/jira/browse/FLUME-2885. Currently, the SyslogUDPSource truncates messages > 2K. With this fix, the default behavior remains the same (2K is used for the buffer size), but if a user specifies a value for datagramSize in the flume configuration, then that size is used instead. If we want to use AdaptiveReceiveBufferSizePredictor to avoid allocating buffers that are larger than necessary, 'someone' is going to have to develop a more comprehensive fix. This at least allows for udp syslog users with messages larger than 2K to process their messages without truncation.

I have deployed this fix in two environments where syslog messages can be larger than 2K, and it works as expected.

ryanpersaud avatar Mar 15 '16 20:03 ryanpersaud

Hmm, it occurs to me that I should probably set datagramSize to the min of datagramSize and maxsize.

ryanpersaud avatar Mar 15 '16 21:03 ryanpersaud

Can one of the admins verify this patch?

asfgit avatar Aug 17 '18 13:08 asfgit

Is this project still alive?

maralla avatar Apr 29 '19 03:04 maralla

Yes

szaboferee avatar Apr 29 '19 10:04 szaboferee