张方琛

VllM ： NCCLerror: unhandled system error (run withNCCL DEBUG=INFo for details)

4

### System Info / 系統信息 centos x84_64 、xinference:1.21 、cuda 12.4 、GPU: P40*4 ### Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？ - [x] docker / docker - [ ]...

[Feature] Add a switch option for streaming output to the ai-chat node

2

### MaxKB Version 1.10.8 ### Please describe your needs or suggestions for improvements Could a switch option for streaming output be added to the ai-chat node? ### Please describe the...