pyroscope icon indicating copy to clipboard operation
pyroscope copied to clipboard

Data retention period is not as expected

Open cao2358 opened this issue 1 year ago • 3 comments

I reduced the data retention period. After restarting the service, I found that the old data was not removed. Regarding the disk usage problem, is there any way to solve it through horizontal expansion?

cao2358 avatar Jun 28 '23 12:06 cao2358

Hello @cao2358. I'd like to clarify if the old data is shown in the UI or you just see old files on the disk. May I ask you to post the configuration please? Also, if it is possible, could you please post here what the pyroscope_storage_retention_task_duration_seconds metric shows (it is available via /metrics HTTP endpoint)

kolesnikovae avatar Jul 05 '23 06:07 kolesnikovae

@kolesnikovae thanks for replay image image we can see the retention is set to 48h but the disk exists too old file not be deleted

there is the metrics show

curl localhost:4040/metrics | grep pyroscope_storage_retention_task_duration_seconds
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 76256    0 76256    0     0   416k      0 --:--:-- --:--:-- --:--:--  425k
# HELP pyroscope_storage_retention_task_duration_seconds duration of old data deletion
# TYPE pyroscope_storage_retention_task_duration_seconds summary
pyroscope_storage_retention_task_duration_seconds{quantile="0.5"} NaN
pyroscope_storage_retention_task_duration_seconds{quantile="0.9"} NaN
pyroscope_storage_retention_task_duration_seconds{quantile="0.99"} NaN
pyroscope_storage_retention_task_duration_seconds_sum 13148.655237562001
pyroscope_storage_retention_task_duration_seconds_count 11

cao2358 avatar Jul 07 '23 02:07 cao2358

+1 have the same problem with retention

rmn-lux avatar Nov 16 '23 13:11 rmn-lux