connectors icon indicating copy to clipboard operation
connectors copied to clipboard

[fortinet-ti] Store "history" file more compactly

Open gileri opened this issue 1 year ago • 1 comments

Use case

Right now, the connectors stores a file using approx 520MiB to deduplicate ingestion.

Current Workaround

Have ample storage.

Proposed Solution

  • Write the JSON file directly gzipped, to write 50MiB instead of 500MiB
  • Only store what will be needed later : Patterns

Additional Information

Would you be willing to submit a PR?

We strongly encourage you to submit a PR if you want and whenever you want. If your issue concern a "Community-support" connector, your PR will probably be accepted after some review. If the connector is "Partner-support" or "Filigran-support", a dev team make take over but will base its work on your PR, speeding the process. It will be much appreciated.

gileri avatar Dec 13 '24 09:12 gileri

@helene-nguyen a thought ?

sbocahu avatar Jun 20 '25 14:06 sbocahu