dcasota
dcasota
same result, default settings. gpu2 is not used. workload goes to cpu. Setup: gpu0: Intel Iris Xe graphics gpu1 (offline): Nvidia RTX 4070 gpu2: Nvidia RTX A500 ``` 2024/01/12 16:51:55...
As a volunteer feedback on this - after ollama-0.1.20, ext_server_common.go isn't part of the repo anymore, right? On an ollama [make build](https://github.com/jmorganca/ollama/files/13918586/build_output.txt) with latest source I haven't seen a segmentation...
@YuryAlsheuski With an older branch of llama.cpp, the manual import seems to work ``` sudo tdnf install -y git-lfs git git lfs install git clone -b b2536 https://github.com/ggerganov/llama.cpp.git cd llama.cpp...
@wouterverduin for Dutch language support in an Ollama installation, you might use `sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2`. Here a list with the LLMs mentioned in this thread. ``` Embeddings LLM | in Ollama hub?...
Hi, Try the following custom setup. It works flawlessly so far. As first attempt, it does not include any cpu and ram limitations&reservations for the service subcomponents. Those can be...
Same issue with v0.1.39. Luckily the workaround works, with Nvidia drivers 552 (see https://github.com/ollama/ollama/issues/4563). edited June 5th: Same with v0.1.41. edited June 19th: Same with 0.1.44. Add `pip install chromadb==0.5.0`
Hi @naltanov, Can you have a look to content completeness? - content/en/docs-v4 - content/en/docs-v3 -> accordingly to [here](https://blogs.vmware.com/vsphere/2023/05/announcing-photon-os-5-0-general-availability.html), Photon OS 3.0 is eol, right? - spelling auto_livepauto_livepatch.sh and disenabled -...
@naltanov awesome++ pull content. Really a must with many new things. I don't know why PhotonOS team seldom merges pull requests from the open source community and from internals. Curated...
+1 @sshedi please provide an instruction recipe on how kernel option modification should be repackaged. How to live test e.g. the following Ph4 rev2 kernel header source change? How to...
Hi @sshedi, > Yes you can. Download the kernel src.rpm from https://packages.vmware.com/photon/4.0/photon_srpms_4.0_x86_64/ and get started. Can you provide an example about "and get started" ? The following make menuconfig snippet...