logfire icon indicating copy to clipboard operation
logfire copied to clipboard

Custom data retention periods

Open summerscope opened this issue 1 year ago • 8 comments

Summary

Currently data retention period for Logfire is one month for all users.

This design choice is important for keeping queries performant, and keeping the service affordable. However we recognise that there may be folks who need longer retention periods for a variety of reasons. If this is you, we encourage you to subscribe to this issue, and comment about your specific data retention needs.

You can also email us at [email protected] if you'd rather not discuss your needs publically.

summerscope avatar Sep 16 '24 12:09 summerscope

👍 There's also the possibility of having different retention periods for spans vs. metrics, and having some kind of aggregations where the results are stored for longer — e.g. you store error rate, avg response time and/or e-commerce revenue aggregated by day for years.

samuelcolvin avatar Sep 16 '24 12:09 samuelcolvin

Is there room for export, so we can handle long term retention in another tool?

peterlandry avatar Oct 08 '24 08:10 peterlandry

Is there room for export, so we can handle long term retention in another tool?

@peterlandry definitely considering raw data export - it will be for Pro plan users, not the Free tier. Feel free to email us at [email protected] if you'd like to tell us anything else about your use-case.

summerscope avatar Oct 10 '24 16:10 summerscope

Is there room for export, so we can handle long term retention in another tool?

You can read about our Query API in our docs.

Kludex avatar Dec 24 '24 11:12 Kludex

Is there room for export, so we can handle long term retention in another tool?

@peterlandry definitely considering raw data export - it will be for Pro plan users, not the Free tier. Feel free to email us at [email protected] if you'd like to tell us anything else about your use-case.

Is there any information about the Pro plan ? or it doesn't exist yet ?

fruch avatar Jan 30 '25 21:01 fruch

Is there room for export, so we can handle long term retention in another tool?

@peterlandry definitely considering raw data export - it will be for Pro plan users, not the Free tier. Feel free to email us at [email protected] if you'd like to tell us anything else about your use-case.

Is there any information about the Pro plan ? or it doesn't exist yet ?

Pro plan exists > https://pydantic.dev/pricing

summerscope avatar Jan 31 '25 09:01 summerscope

Following - It would be great to have the option for longer retention periods for compliance and auditing purposes.

jonhilgart22 avatar Feb 25 '25 23:02 jonhilgart22

Following - It would be great to have the option for one year retention periods for compliance and auditing purposes.

cc: @jeremy-georgian @doodzik

m-g-b-georgian avatar Mar 28 '25 18:03 m-g-b-georgian