KaiMao LEE comments

Repositories
Issues
Comments

Results 2 comments of


                                            KaiMao LEE

Error:" the current context does not support k-shift " deepseek-r1:671b crashes in memory after answering several questions and then reloads to memory again

> [@sobermh](https://github.com/sobermh) 8*A100 when I increase num_ctx, ollama ps PROCESSOR change to CPU and GPU, 8192 works full GPU I can't understand

Error:" the current context does not support k-shift " deepseek-r1:671b crashes in memory after answering several questions and then reloads to memory again

I have the same setup as you, with 8 A100s and 500G. Could you please advise on the specific configurations, including the service setup and modelfile configurations? @mariaccc