abxis

Results 5 comments of abxis

[Bug] QWEN-235b-a22bprefill阶段特别慢

同，deepseek q4_k_m同问题

[Bug] 部署unsloth/DeepSeek-R1-0528-GGUF/UD-Q8_K_XL 报错

UD-IQ2_M这个版本也遇到/pytorch/aten/src/ATen/native/cuda/TensorCompare.cu:112: _assert_async_cuda_kernel: block: [0,0,0], thread: [0,0,0] Assertion `probability tensor contains either `inf`, `nan` or element < 0` failed.错误了，也是这个版本不支持吗？

多并发胡言乱语

ftllm serve Qwen2.5-72B-Instruct-AWQ --device multicuda:0,1 --moe_device numa --model_name="Qwen2.5-72B-Instruct-AWQ" --think THINK，启动命令是这个

[Bug] connect vector store failed: Query execution failed: {code: CypherException}

![微信图片_20241011135720](https://github.com/user-attachments/assets/09dceeea-1fa1-46ee-a03f-9ebb1e09fa60) ![微信图片_20241011135851](https://github.com/user-attachments/assets/d8da0240-3b4b-4c4c-9e7c-93745fa99d51) 这个怎么解决呢？

[Bug] connect vector store failed: Query execution failed: {code: CypherException}

> 没错，确实是这样，修改路径：dbgpt\storage\graph_store\tugraph_store.py 修改如下： ![image](https://private-user-images.githubusercontent.com/91660514/372590498-041be661-8470-4086-96e0-ac64cba1643b.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mjg2MjY0MTQsIm5iZiI6MTcyODYyNjExNCwicGF0aCI6Ii85MTY2MDUxNC8zNzI1OTA0OTgtMDQxYmU2NjEtODQ3MC00MDg2LTk2ZTAtYWM2NGNiYTE2NDNiLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDEwMTElMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQxMDExVDA1NTUxNFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWU2YjVlMjYzOTViNzAxZjVmODUyMzc2NzUwNGQ3ZjQzM2M1MmFkNDFhMzQzNTAwYjZkMzk4YzhkYTBlNjIzZWQmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.iuCRGnDgXHa3VsFsyZA4coj7eJRMeVVnG1jkW3azW8s) ![微信图片_20241011135851](https://github.com/user-attachments/assets/2ce02bc1-9582-453f-bcd1-3297c2c1fea2) 这个怎么解决呢？