cloudberry icon indicating copy to clipboard operation
cloudberry copied to clipboard

ic-proxy: interconnect error: connection closed prematurely

Open liyxbeijing opened this issue 1 year ago • 2 comments

Cloudberry Database version

postgres=# select version(); version



PostgreSQL 14.4 (Cloudberry Database 1.4.0 build commit:e83e3ffc22d538deb2dbceeeae0138ca2de064e6) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 8.3.1 20191121 (Anolis 8.3.1-5.0.1.1) , 64-bit compiled on Sep 17 2023 23:10:22 (with assert checking) (1 row)

What happened

interconnect type set as proxy and received below errors:

master:

2024-01-08 12:18:03.418100 CST,",p493382,th-1664801920,""46890",2024-01-08 10:17:46 CST,0,con159,cmd23,seg-1,,dx6366183,,sx1,"ERROR","58M01","interconnect error: connection closed prematurely  (seg19 xxx.xxx.xxx.xxx:6003 pid=39387)","from Remote Connection: contentId=60 at",,,,,"insert into xxxx select  starttime ,period 

segment:

2024-01-08 13:01:37.711883 CST,,,p45134,th235180928,,,,0,,,seg19,,,,,"WARNING","01000","peer[seg60,dbid62 xxx.xxx.xxx.xxx:16003->xxx.xxx.xxx.xxx:55071]: fail to shutdown: socket is not connected",,,,,,,0,,"ic_proxy_peer.c",446,
2024-01-08 13:01:37.713647 CST,,,p45134,th235180928,,,,0,,,seg19,,,,,"WARNING","01000","client[con64863,cmd3,slice[1->0] seg19:dbid21:p67661->seg48:dbid50:p640943]: fail to receive c2p DATA: connection reset by peer",,,,,,,0,,"ic_proxy_client.c",502,
2024-01-08 13:01:37.713728 CST,,p67661,th235180928,","10265",2024-01-08 13:01:09 CST,1909017,con64863,cmd3,seg19,,dx6366775,x1909018,sx2,"ERROR","58M01","interconnect error: connection closed prematurely","from Remote Connection: contentId=60 at",,,,,"insert into xxxxxx ^M
select a.starttime,^M

gp_interconnect_proxy_addresses port : 16003

What you think should happen instead

No response

How to reproduce

it is reproducing easily.

Operating System

BELinux.

Anything else

No response

Are you willing to submit PR?

  • [ ] Yes, I am willing to submit a PR!

Code of Conduct

liyxbeijing avatar Jan 08 '24 05:01 liyxbeijing

Any reproducible steps?

my-ship-it avatar Aug 21 '24 05:08 my-ship-it

we find the similar error at PostgreSQL 14.4 (Cloudberry Database 1.0.0+d0ac915 build dev) on x86_64-pc-linux-gnu, compiled by gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-22), 64-bit compiled on Jun 27 2024 16:27:36

1、Use gpfdist to create an external table 2、then use insert into to insert the data from the external table into the business table 3、then delete the external table. In high concurrency situations, this error occurs very frequently. the master error :2024-08-28 07:54:30.058095 CST,"edw","edw",p494437,th-143910784,"0.0.0.0","56664",2024-08-28 07:53:15 CST,242165,con53784,cmd10,seg-1,,dx285094,x242165,sx1,"ERROR","58M01","failed to acquire resources on one or more segments","connection to server at ""0.0.0.1"", port 6002 failed: server closed the connection unexpectedly

geometa avatar Aug 28 '24 02:08 geometa