zenml-projects
zenml-projects copied to clipboard
Use QDoRA instead of just LoRA
Uses QDoRA instead of just LoRA. This has some efficiency benefits, notably faster training without a corresponding performance loss. See this for more details.
The code on the base branch was also unformatted, but (aside from formatting changes) I've highlighted the specific lines where I've actually changed code.