obsidian-copilot icon indicating copy to clipboard operation
obsidian-copilot copied to clipboard

[FR] Add customization to the local embedding model

Open wwjCMP opened this issue 1 year ago • 5 comments

Now I need to change the embedding model in ollama to the name preset by this plugin, and I hope to be able to customize the name of the embedding model.

wwjCMP avatar Mar 22 '24 16:03 wwjCMP

As an additional comment - has there been any research into adding a local embedding scheme that doesn't even require an LLM? A similar plugin, Smart Connections, offers a variety of embedding options that can be ran right from the plugin. I think it would be great to ship one or two similar options so that users with LM Studio (or users without the desire to spin up a second model) can just leave the embeddings generation to the plugin.

leethobbit avatar Apr 01 '24 21:04 leethobbit

@leethobbit Thanks for the suggestion. I believe Smart Connections uses transformers.js for that and not Ollama for that to happen. I tried once before but couldn't make transformers.js work in the Obsidian plugin env. Not sure how they made it work, but it's certainly possible given that they've done it already.

logancyang avatar Apr 01 '24 22:04 logancyang

Thanks for the quick response! I'm mostly a Python dev and don't have a strong grasp on either JS or the AI embedding stuff, but I'll take a look at both plugins to see if I can't help in some way.

leethobbit avatar Apr 02 '24 13:04 leethobbit

I also need a model that supports chinese embedding, need this feature

muzhi1991 avatar Apr 21 '24 09:04 muzhi1991

I also need a model that supports chinese embedding, need this feature

I hope so! Copilot could do something like the smart connections plug which provides Jina v2 (EN & CN)

zhcqiu avatar May 01 '24 02:05 zhcqiu

With custom models, closing this old issue. If anything is not working with custom model, please open separate issues with details.

logancyang avatar Sep 29 '24 19:09 logancyang