thanos icon indicating copy to clipboard operation
thanos copied to clipboard

Loading delayed data into Thanos

Open kojderszymon opened this issue 3 years ago • 1 comments

I am using Minio and Thanos (with receiver) to collect data from Prometheus and my own application via remote write. A problem arises when via remote write I would like to upload older, late data. With the default settings, I can upload data from a few hours ago, but this is not enough. For example, I would like to load data from 24 hours ago. Will I be able to achieve this? Will increasing --max-block-duration and --min-block-duration solve the problem? Is there any work to solve my problem currently being done?

kojderszymon avatar Jul 19 '22 10:07 kojderszymon

This is a limitation with the Prometheus TSDB. The only way to backfill data older than a few hours is to upload TSDB blocks directly to S3 from where you can query them with Store Gateway.

fpetkovski avatar Jul 31 '22 11:07 fpetkovski

Hello 👋 Looks like there was no activity on this issue for the last two months. Do you mind updating us on the status? Is this still reproducible or needed? If yes, just comment on this PR or push a commit. Thanks! 🤗 If there will be no activity in the next two weeks, this issue will be closed (we can always reopen an issue if we need!). Alternatively, use remind command if you wish to be reminded at some point in future.

stale[bot] avatar Oct 01 '22 10:10 stale[bot]