Daijiro Fukuda
Daijiro Fukuda
@jicowan We are trying to reproduce this issue. Could you please tell us how to reproduce this in detail? I can run the node with the test application, but I...
I think I need to have a file like `/var/log/containers/...` and collect it by in_tail, but I don't know how to do that. If I set up a pod as...
@Watson1978 Thanks for investigating! So, the problem is that the rotation occurs at very high speed. In that case, it is certainly better to set `follow_inodes false` (default) and `rotate_wait...
> During heavy log volumes, e.g. >10k log entries per second, fluentd consistently drops logs. Hmm, does setting `follow_inodes false` and `rotate_wait 0` causes log lost? Looks like we need...
@jicowan Sorry for my late response. I have investigated this issue and I have found the cause. As a conclusion, if there is a log file that receives a high...
I see. Thanks. Then, currently, [read_bytes_limit_per_second](https://docs.fluentd.org/input/tail#read_bytes_limit_per_second) setting will help stabilize the collection. > Can you make a single instance of in_tail multi-threaded so the logs are read faster? I don't...
If you have too many logs for a particular file, you can use the workaround described in https://github.com/fluent/fluentd/issues/4693#issuecomment-2796483918. If there are too many logs overall to be read, then we...
Now this issue is to discuss improvements in the following points. (Maybe we should create another issue, but for now...) > As a conclusion, if there is a log file...
Thanks! It appears that we need to fix other areas. For example: https://docs.fluentd.org/deployment/logging#output-to-log-file It would be a bit difficult for users to understand this feature because it can also be...
Thanks for this update!