ragflow icon indicating copy to clipboard operation
ragflow copied to clipboard

xinference model mount failure

Open ciaoyizhen opened this issue 1 year ago • 0 comments

Describe your problem

I started chatglm3-32k via xinference, then clicked inside xinference add model inside ragflow and entered {model category -> chat, model uid -> THUDM/chatglm3-6b-32k, base url -> ip+port of xinference service} fail to access model(THUDM/chatglm3-6b-32k). ERROR; Connection error.

ciaoyizhen avatar May 10 '24 07:05 ciaoyizhen