ollama codestral need more VRAM in the version 0.8.46

[zhangyanru2019]

Before submitting your bug report

• [x] I believe this is a bug. I'll try to join the Continue Discord for questions
• [x] I'm not able to find an open issue that reports the same bug
• [ ] I've seen the troubleshooting guide on the Continue Docs

Relevant environment info

- OS:
- Continue:
- IDE:
- Model:
- config.json:

Description

in the version 0.8.46, ollama codestral need more than 16GB VRAM ,but the version before 0.8.44 didn't need

To reproduce

No response

Log output

No response

[sestinj]

@zhangyanru2019 Can you take a look at the output of ollama ps and let me know if this is different when running version 0.8.46 vs. 0.8.44?

[zhangyanru2019]

I have attach the capture photo, why the same model "codestral" ,the new version need more than 16GM VRAM ,I use rtx4060ti 16GB GPU

[zhangyanru2019]

@sestinj please see the upside comment

[github-actions[bot]]

This issue hasn't been updated in 90 days and will be closed after an additional 10 days without activity. If it's still important, please leave a comment and share any new information that would help us address the issue.

[github-actions[bot]]

This issue was closed because it wasn't updated for 10 days after being marked stale. If it's still important, please reopen + comment and we'll gladly take another look!