Yash Chittora

I have 8gb currently on this machine. I know it may be less for a 7b parameter model , but it used to run mistral earlier this month with ease....

I have tried removing the model completely and installing it again. Running it caused a kernel panic this time and the whole computer crashed and did a restart. After restart...

@mattbisme Didn't seem to work for me. Maybe I need another machine. Still I wonder that was it ruuning all of this a few weeks earlier.

@prantlf 3b models run fine and fast on my laptop. The issue somewhere is with the 7b models.

Same happening with me. The latest versions tend to use more memory than the previous ones.