Wesley Pettit

@JeffLuoo AFAIK, no work has been done on it yet.

@mohitjangid1512 No work has been done AFAIK on chunk sizing for outputs

Report from my customer: ### Using fluent/fluent-bit:1.9.6-debug to test, also reproduced the bug. ``` {"log":"[2022/07/20 05:23:41] [debug] [input chunk] update output instances with new chunk size diff=32768\n","stream":"stderr","time":"2022-07-20T05:23:41.186176801Z"} {"log":"[2022/07/20 05:23:41] [debug]...

@ptsneves We have not been able to get a core dump yet, will post it if we get one.

I did get a core dump, but its a huge, half a GB, and when I try to read it, I don't get much: ``` Core was generated by `/fluent-bit/bin/fluent-bit...

Now that I installed all of the debug infos, I get: ``` warning: Could not load shared library symbols for 2 libraries, e.g. /lib64/libssl.so.1.1. Use the "info sharedlibrary" command to...

Alrighty so we installed all the debuginfos and then got it to pick up the raw fluent bit code and dumped the stack for all threads. Unfortunately I am still...

@tarruda in 1.9.4 S3 already had default 1 workers enabled, as does Kinesis. So this was reproduced with 1 worker.

@tarruda the only config I have repro'd it with is basically what is shown in the issue. Since I don't know what causes it I didn't try removing anything from...

This bit from another stack trace is probably the key bit: ``` [2022/07/25 08:28:30] [error] [storage backlog] could not retrieve chunk tag from tail.0/1-1658736195.926695132.flb, removing it from the queue [2022/07/25...