citusdata
Requests wont give any error but it will be hung.
We have a scenario where most of our queires are going to be in ques and hangs and will get no response for specific tables. while we are unable to get the data from tables and modify specific tables. these queries will be running for more time and wont even timeout or any.. No response from tables on queries.
citus_version: Citus 12.1.1 on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit.
Fyi. select count() from assets; select count() from agents;
ccnsapp=# ANALYZE VERBOSE agents;
INFO: analyzing "public.agents" INFO: "agents": scanned 0 of 0 pages, containing 0 live rows and 0 dead rows; 0 rows in sample, 0 estimated total rows
FATAL: terminating connection due to administrator command server closed the connection unexpectedly This probably means the server terminated abnormally before or while processing the request. The connection to the server was lost. Attempting reset: Succeeded.
ccnsapp=# SELECT undistribute_table($$public.agents$$, cascade_via_foreign_keys=>true);
no response.^.
queries on others table works fine.
for the other tables the qeuries runs fine. select count(*) from ad_groups_ad_computers_map; count
45343 (1 row)
select count(*) from asset_firewall_rules; count
20632583 (1 row)
am unable to run queries on specifi table in database. or how can we know whats happening.
Since this was causing the issue, we had 8 nodes cluster of citus,
we drained the 5 nodes one by one, added back. when we reach to the 6th node it started move the shard, the single shard was moving.
if i remove the node will that cause any issue.. any one please suggest us.