Julian Stastny

Sanity check: How to run inference after fine-tuning Llama-3 on chat data?

6

Hi! I'm hopeful that I'm doing this correctly, but not completely sure, and I don't know how best to verify this -- I've fine-tuned Llama-3 8B (using qlora) following this...