radhacr

Gemma inference CUDA illegal memory access error

7

### Please check that this issue hasn't been reported before. - [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports. ### Expected Behavior The training with the Gemma...

Seeing the following error while saving the model, while trying to pretrain the mistral-7b model with the pile-of-law dataset ``` Traceback (most recent call last): File "/data/qgalore/Q-GaLore/run_pretrain_mistral.py", line 688, in...