Anderson Queiroz

There is an increase in memory consumption, but so far it wasn't problematic. [Here](https://ingest-metricstore.kb.us-central1.gcp.cloud.es.io:9243/app/dashboards#/view/111946f4-f095-4810-a07f-b742be4c1e4e?_g=h@17abbaf) is the dashboard from where I took the screen shot. Running benchbuilder in CI isn't the...

also, the memory consumption of filestream should be proportional to the number of files being harvested at the same time. Harvesting gzip files should increase memory consumption by a fixed...

Edit: benchbuilder is still failing to run the benchmark for a large file (48gb so it won't run out of disk space). That's why each case used a different approach...

I got the benchmark for a [~48gb file with benchbuilder](https://ingest-metricstore.kb.us-central1.gcp.cloud.es.io:9243/app/r/s/7OQVx). In this case we don't see a memory increase as there is just one instance of the GZIP reader. The...

Not I got why I have a hard time reading your graphs, they don't display well in dark mode. I guess it's because it's SVG, not an image.

@cmacknz with the current results, do you think we still need to do the _Benchmark the Kubernetes integration with a mix of plain and GZIP files, including rotation scenarios._? You...

> The benchmark results here show the performance hit of reading gzip are not a major concern. > > I think we should track enabling reading of gz files in...

> > is being released as experimental, not yet GA. > > It should be beta, experimental is something we might remove and this is not one of those. >...

@faec I did the changes and the tests are passing now, the broken ones are unrelated to this PR, as soon as main is fixed, I'll update this branch @elastic/sec-deployment-and-devices...

hey @taylor-swanson I think I need your approval again YOu had approved on behalf of @elastic/integration-experience, right? I'm not sure why, but I need approval from integration-experience again