mistral.rs icon indicating copy to clipboard operation
mistral.rs copied to clipboard

Add optimized RmsNorm and RoPE

Open EricLBuehler opened this issue 11 months ago • 1 comments

Removing contiguous calls in rmsnorms and RoPE might help.

EricLBuehler avatar Mar 25 '25 11:03 EricLBuehler

Code Metrics Report
  ===============================================================================
 Language            Files        Lines         Code     Comments       Blanks
===============================================================================
 C Header                2           34           29            0            5
 Dockerfile              1           41           22           10            9
 JSON                   12          105          104            0            1
 Makefile                1            6            5            0            1
 Python                 75         3138         2720           83          335
 Shell                   1           63           26           18           19
 Plain Text              3         3723            0         2413         1310
 TOML                   19          540          496            6           38
 YAML                    2           21           19            2            0
-------------------------------------------------------------------------------
 Jupyter Notebooks       3            0            0            0            0
 |- Markdown             2           77           32           31           14
 |- Python               2          205          178            1           26
 (Total)                            282          210           32           40
-------------------------------------------------------------------------------
 Markdown               51         4409            0         3346         1063
 |- BASH                 8          106          103            0            3
 |- JSON                 1           12           12            0            0
 |- Python               7          121          109            0           12
 |- Rust                18          623          526            0           97
 |- TOML                 2           75           63            0           12
 (Total)                           5346          813         3346         1187
-------------------------------------------------------------------------------
 Rust                  344       114533       102546         2207         9780
 |- Markdown           159         1820           25         1653          142
 (Total)                         116353       102571         3860         9922
===============================================================================
 Total                 514       126613       105967         8085        12561
===============================================================================
  

github-actions[bot] avatar Mar 25 '25 11:03 github-actions[bot]