frob

Results 843 comments of frob

Unfortunately there's nothing untoward in the log. The model loads successfully, your `bonjour` is processed in 181ms and your question apparently in 129s. There are some other commands I take...

``` time=2024-11-11T21:50:18.837+01:00 level=INFO source=common.go:49 msg="Dynamic LLM libraries" runners="[cpu_avx cpu_avx2 cpu]" ``` Arch Linux user? https://github.com/ollama/ollama/issues/7564

https://github.com/ollama/ollama/blob/main/docs/development.md#advanced-cpu-vector-settings

https://github.com/ollama/ollama/blob/main/docs/development.md#advanced-cpu-vector-settings

```console make -j16 CUSTOM_CPU_FLAGS="" CUDA_12_PATH=/usr/local/cuda-12.6/ RUNNER_TARGETS=cuda_v12 runners ```

Might be an upstream issue, this has been reported several times over the last few weeks. #8406, #8384, #8330, #8280 https://github.com/ollama/ollama/issues/8330#issuecomment-2574510267 contains an explanation for the observed behavior, but no...

There's confusion about what the actual issue is. The "reversing during download" issue has been mitigated with #8831. What I believe people are seeing now, and attributing to "reversing during...

This should be mitigated as of 0.5.8 by #8831 and #9294 provides an overhaul of model pulling, so closing but feel free to add updates if you are still having...

What issue: stalling causing chunk restart, or slow chunks causing a slowdown? Logs may help.

dd20bb891979d25aebc8bec07b2b3bbc.r2.cloudflarestorage.com has always been a problematic host. I've seen speculation that this also hosts content that occasionally falls afoul of copyright laws and that some ISPs block/limit connections to that...