ProjectProgramAMark

Creating a module version of lora.py (for referencing the functions in other scripts)

3

Just adding a module version of `lora.py`. This is so that you can call in the training, testing, and generating functions into another python script. It was quite useful for...

Question: VRAM requirements for training, finetuning, and inference?

3

Do we have a general sense on this? Has LoRA/QLoRA fine tuning been attempted on this, and if so, any guidance?