citus icon indicating copy to clipboard operation
citus copied to clipboard

pgsql_job_cache folder size grows unusually large #7691

Open adnanhamdussalam opened this issue 10 months ago • 3 comments

Hi,

I am facing the same issue (pgsql_job_cache folder size grows unusually large #7691) and there are no active queries that executing but still the size is very high of pgsql_job_cache as you mention in the #7691 as a workaround, we can manually remove the folders in directory pgsql_job_cache.

Kindly can you confirm it?

PG Version: 16.3 Citus Version: 12.1.4

adnanhamdussalam avatar Feb 21 '25 10:02 adnanhamdussalam

Thank you for reporting. I just closed the linked issue due to no activity. Can you please provide further details/reproduction steps that led you to this state. As mentioned in #7691, "... If there is no query running at the moment, it should be fine to empty pgsql_job_cache folder."

ihalatci avatar Feb 25 '25 14:02 ihalatci

Thank you for the update. In my database there is a lot of hash joins against huge tables but when query completes, or session ended then this folder "pgsql_job_cache" should empty automatically but it does not release the space at disk, so I do not want to get into a disaster situation after removing the files from the folder. So, I was just want the reconfirmation that it is safe to remove the files without impacting the database if no query is in executing state.

adnanhamdussalam avatar Feb 25 '25 17:02 adnanhamdussalam

Once you grep the server logs, do you see any errors about "pgsql_job_cache" that starts with any of these?

  • could not stat file
  • could not open directory
  • could not remove file

If so, could you share the underlying error?

Also, it should be safe to clean-up this directory if no active queries are using it.

onurctirtir avatar Mar 06 '25 13:03 onurctirtir