Liangqi zhu

Regarding the issue with Multi-Concurrency Support, when using the backend_type and balance_serve parameters, a segmentation fault (segfault) occurs at the final stage of model loading.

15

Current configuration： OS: Ubuntu 22.04.1 ktransformers：0.3.1+cu128torch27fancy CPU：GENUINE INTEL(R) XEON(R) Core(s) per socket: 72 Socket(s): 2 GPU：A6000 memory: 1.47T Run cmd:  Build ktransformser cmd: # For those who have two...