lost log files under high load (using .gz)

[dasvex]

Description

In our production, entries in log files are lost under high load. It is possible that this is due to the archiving process.

It seems that if the file archiving of one file is not completed and the second one is already starting to archive, they can overwrite each other.

Configuration

Version: [2.24.3]

Operating system: [Oracle Linux Server 8.4; win10]

JDK: [21]

Reproduction

Most likely, the problem will reproduce well on weak servers, where the file archiving process takes some considerable time. For example, on servers with a slow HDD or with a slow CPU.

Simple test to reproduce here: https://github.com/dasvex/log4j-lost-files-on-gz/tree/main

[vy]

@dasvex, thanks so much for the report and the reproduction.

These kind of issues often require significant effort (and skill set) to troubleshoot. AFAICT, currently the only active Log4j maintainers (myself, and @ppkarwasz?) are significantly limited in their maintainer time. My personal advice is to see if you can further troubleshoot the issue yourself, or seek other support options.