ai-fxz

Results 7 comments of ai-fxz

The list of Llama3 8B model files is as follows:

Now the model can be loaded again, but I feel like it sometimes works and sometimes it doesn't. Moreover, after loading the model, I keep running data and chatting on...

> Can you make sure you have the latest NVIDIA drivers / CUDA toolkit installed too? Isn't this command used for the NVIDIA drivers/CUDA toolkit version? nvidia-smi And NVCC-V?

> Good to know it at least works in WSL. OPENCL is always going to be quite slow. You’ll want to configure your NVIDIA drivers so that your GPU is...

> I just bumped up the tinygrad version [1426826](https://github.com/exo-explore/exo/commit/142682645f2c8b480e1105c1d8c2dc0a9b767815), since it was quite old. Can you try with the latest version? These questions still exist, thank you

![WechatIMG41](https://github.com/user-attachments/assets/0991dbaa-acf3-4712-a24b-13e13b6b4c51)