citus icon indicating copy to clipboard operation
citus copied to clipboard

pgsql_job_cache folder size grows unusually large

Open nguoingoai opened this issue 1 year ago • 3 comments

My Coordinator node have a folder pgsql_job_cache , recently size grows unusually large , this size is larger than folder data on this node . So what is the reason and how to fix this ?

nguoingoai avatar Sep 25 '24 15:09 nguoingoai

Citus keeps intermediate result files in pgsql_job_cache folders. It may grow depending on your intermediate result sizes but should be cleaned-up after the queries are done. So when there is no running query it should not have anything in it. Do you observe otherwise?

emelsimsek avatar Sep 27 '24 09:09 emelsimsek

I thinks some query was kill when it running, Can I delete these files without effecting the data ?

nguoingoai avatar Sep 29 '24 03:09 nguoingoai

There was a few intermediate result file leak bugs, it is possible that you have run into them. What citus version are you on? And what are your schema/queries like?

As a workaround, If there is no query running at the moment, it should be fine to empty pgsql_job_cache folder.

emelsimsek avatar Oct 01 '24 12:10 emelsimsek

Closing due to no response, please reopen if you still running into this issue with version details.

ihalatci avatar Feb 25 '25 14:02 ihalatci