dcasota
dcasota
edited May 18th 2024: The earlier recipes do not work with Ollama v0.1.38 and privateGPT still is broken. The issue cause by an older `chromadb` version is fixed in v0.1.38....
Hi, In `.venv/lib/python3.10/site-packages/langchain_community/embeddings/ollama.py` see line beginning with ` model: str = "llama2"`. After changing it, your code doesn't produce an error anymore (tested with python 3.11 and issue fix https://github.com/ollama/ollama/issues/2572#issuecomment-2070514858)....
@thinkverse Actually there is no much choice. E.g. `mxbai-embed-large` is listed, however in `examples/langchain-python-rag-privategpt/ingest.py` and `privateGPT.py` it cannot be used, because the api path isn't in /sentence-transformers. On the same...
For Multi-Instance GPU (MIG) support, see https://docs.nvidia.com/datacenter/tesla/mig-user-guide/index.html#supported-gpus. For tesla v100: _MIG is supported on systems that include the supported products above such as DGX, DGX Station and HGX._
@fpreiss Accordingly to https://github.com/NVIDIA/open-gpu-kernel-modules/issues/256 for kernel 5.18, `ibt=off` fixed an arch kernel configuration specific issue for nvidia. Your kernel is 6.6.10-arch1-1, hence you could give a try to that kernel...
> Hi @dcasota, @thinkverse! I tried to convert `paraphrase-multilingual-MiniLM-L12-v2` to gguf like: `python /root/.ollama/ollama/llm/llama.cpp/convert-hf-to-gguf.py ./paraphrase-multilingual-MiniLM-L12-v2 --outtype f16 --outfile paraphrase-multilingual-MiniLM-L12-v2.gguf` but have the next trace: > > Loading model: paraphrase-multilingual-MiniLM-L12-v2 gguf:...
It may be yet another subcomponent issue. With v0.1.38, langchain version is 0.0.274. ``` pip3 list | grep langchain langchain 0.0.274 ``` Not use of e.g. langchain_community. As workaround, I've...
@dhiltgen On Windows, the user experience should be improved. Here a W11 example with Docker desktop and pulling latest Ollama.  The issue has been reported in https://github.com/ollama/ollama/issues/4146
`chatgpt install` requires that the system has browser functionality. A class separation for e.g. `--use-device-code` would be helpful to use the tool on minimal os as well.