lightning-thunder
lightning-thunder copied to clipboard
Automated litgpt benchmarks
🚀 Feature
As suggested by @Borda it would be nice to have automated litgpt benchmarks for thunder, in the same format as the HF model benchmarked through https://github.com/Lightning-AI/lightning-thunder/blob/main/.github/run-benchmark-as-lit-jobs.py.
Motivation
More coverage from automated benchmarks, giving a better overview of thunder's performance.
cc @borda