Peter Devine
Peter Devine
Bump. I'd like to see this implemented as my own personal experience of training models such as RAG models using Axolotl definitely benefit from not training on inputs. This makes...
Bump - this would be a really useful feature that would massively speed up eval time
If anyone finds this thread looking to fix the error with installing Axolotl on Colab, I was getting an error where there were conflicting versions of torch required. This is...
@strickvl I have got it working using these packages: ```bash ! pip install torch==2.3.1 ! pip install -e git+https://github.com/axolotl-ai-cloud/axolotl#egg=axolotl ! pip install -q datasets evaluate trl ! pip install torchvision==0.18.1...
Hmmm, I guess that different usages require different installations as I have the code working, but I am not performing QLoRA so I don't require PEFT etc. For the sake...
@JohnUiterwyk , has this not been fixed by the suggestions from @dspoka and @spreadingmind ? Their suggestions worked for me.