theRainight comments

Repositories
Issues
Comments

Results 2 comments of


                                            theRainight

[Question]: There are issues using ollama's local model for chat.

@Magicbook1108 I tried three LLM models: one was the online SILICONFLOW-provided DeepSeek-R1-Distill-Qwen-32B, which functioned normally. Another was the locally deployed Deepseek-R1:32B using sglang, which only showed the start-of-thinking marker but...

[Question]: Why can't we alter to another embedding model?

> We can't compute similarity of vectors generated by different embedding model. I am using the built-in embedding model BAAI. After upgrading to version 0.22, the embedding model for the...