Add Draft LoRA scripts

Open shuaills opened this issue 4 months ago • 1 comments

Motivation

This PR added training scripts for LoRA. This is a draft PR, do not merge.

Acc on W/WO LoRA

[ ] Format your code according to the Code Formatting with Pre-Commit.
[ ] Add unit tests as outlined in the Running Unit Tests.
[ ] Update documentation / docstrings / example tutorials as needed, according to Writing Documentation.
[ ] Provide throughput / latency benchmark results and accuracy evaluation results as needed, according to Benchmark and Profiling and Accuracy Results.
[ ] For reviewers: If you haven't made any contributions to this PR and are only assisting with merging the main branch, please remove yourself as a co-author when merging the PR.
[ ] Please feel free to join our Slack channel at https://sgl-fru7574.slack.com/archives/C09784E3EN6 to discuss your PR.

Aug 13 '25 13:08 shuaills

cc @shuaills is still working on this and this PR is not ready yet. I will leave it open

Oct 20 '25 15:10 zyksir