mistral.rs
mistral.rs copied to clipboard
Add tracking of memory usage
This will implement memory usage tracking. This will be used for #377.
- [x] CPU
- [ ] CUDA: https://docs.rs/cudarc/latest/cudarc/driver/result/fn.mem_get_info.html
- [ ] Metal
Code Metrics Report
=============================================================================== Language Files Lines Code Comments Blanks =============================================================================== Dockerfile 1 34 25 0 9 Happy 1 442 369 0 73 JSON 10 66 65 0 1 Python 36 1412 1220 38 154 TOML 18 518 458 11 49 ------------------------------------------------------------------------------- Jupyter Notebooks 1 0 0 0 0 |- Markdown 1 60 30 22 8 |- Python 1 96 87 1 8 (Total) 156 117 23 16 ------------------------------------------------------------------------------- Markdown 21 1554 0 1173 381 |- BASH 5 101 98 0 3 |- JSON 1 12 12 0 0 |- Python 5 98 88 0 10 |- Rust 4 221 198 10 13 |- TOML 2 75 63 0 12 (Total) 2061 459 1183 419 ------------------------------------------------------------------------------- Rust 131 44177 40056 775 3346 |- Markdown 77 723 13 671 39 (Total) 44900 40069 1446 3385 =============================================================================== Total 220 48203 42193 1997 4013 ===============================================================================