mistral.rs
mistral.rs copied to clipboard
Add optimized RmsNorm and RoPE
Removing contiguous calls in rmsnorms and RoPE might help.
Code Metrics Report
=============================================================================== Language Files Lines Code Comments Blanks =============================================================================== C Header 2 34 29 0 5 Dockerfile 1 41 22 10 9 JSON 12 105 104 0 1 Makefile 1 6 5 0 1 Python 75 3138 2720 83 335 Shell 1 63 26 18 19 Plain Text 3 3723 0 2413 1310 TOML 19 540 496 6 38 YAML 2 21 19 2 0 ------------------------------------------------------------------------------- Jupyter Notebooks 3 0 0 0 0 |- Markdown 2 77 32 31 14 |- Python 2 205 178 1 26 (Total) 282 210 32 40 ------------------------------------------------------------------------------- Markdown 51 4409 0 3346 1063 |- BASH 8 106 103 0 3 |- JSON 1 12 12 0 0 |- Python 7 121 109 0 12 |- Rust 18 623 526 0 97 |- TOML 2 75 63 0 12 (Total) 5346 813 3346 1187 ------------------------------------------------------------------------------- Rust 344 114533 102546 2207 9780 |- Markdown 159 1820 25 1653 142 (Total) 116353 102571 3860 9922 =============================================================================== Total 514 126613 105967 8085 12561 ===============================================================================