Vincent Bosch
Vincent Bosch
@harvy4002 Did you find a solution? I am running into the exact same problem with the latest LocalAI on my M3 Mac. Thanks in advance!
The issue also appears to be present on Mac. I tried loading Command R Plus and tweaking the penalty-value, but the logs suggests it always loads with "repeat_penalty\":1.0 despite the...
Correction, it appears that the value "repeat_penalty":1.0 always defaults to 1.0 and the "frequency_penalty" is used separately and being reflected correctly. How can I change the default "repeat_penalty"-value or disable...
I just downloaded the Apple Silicon version of Jan 0.4.3 Stable on my M1 Max MacBook Pro. The issue is not present there; it runs on macOS Sonoma 14.0. Furthermore...
> @vlbosch can you reproduce this on the nightly build? https://jan.ai/install/nightly/ I tried it with the nightly. The issue persists, but now I am presented with the error "TIMEDOUT" with...
> @vlbosch Are you getting GPU acceleration with the AMD eGPU? If so, how? I'm also running Mac Intel build. > > I have 64gb RAM and Jan is only...
[app.log](https://github.com/janhq/jan/files/13942533/app.log)
The same issue appears on macOS with GPU support. After the response on the prompt is finished, Jan/Nitro continue to use full GPU as if it empties a cache or...
I made a comment on Discord, but then I found this issue with similar behavior as I am seeing. I am running macOS Sonoma 14.3, M3 Max MBP. I am...
I did a retry with Stream turned of. It appears to run consistent then. After a few questions, I turned Stream on. The first response was in the 20+T/s, but...