mistral.rs
mistral.rs copied to clipboard
Warn instead of throw error in chat template
Code Metrics Report
=============================================================================== Language Files Lines Code Comments Blanks =============================================================================== Dockerfile 1 34 25 0 9 Happy 1 442 369 0 73 JSON 9 21 21 0 0 Python 32 1256 1075 37 144 TOML 16 444 403 1 40 ------------------------------------------------------------------------------- Jupyter Notebooks 1 0 0 0 0 |- Markdown 1 60 30 22 8 |- Python 1 96 87 1 8 (Total) 156 117 23 16 ------------------------------------------------------------------------------- Markdown 19 1364 0 1022 342 |- BASH 5 100 97 0 3 |- Python 5 98 88 0 10 |- Rust 3 151 135 6 10 (Total) 1713 320 1028 365 ------------------------------------------------------------------------------- Rust 121 37354 33750 684 2920 |- Markdown 59 668 13 617 38 (Total) 38022 33763 1301 2958 =============================================================================== Total 201 40915 35643 1744 3528 ===============================================================================
If this is what I think it is, I would be in favour of this being merged. Like f.e. every time an image does not load or something else in the chat is wrongly formatted, it takes some time to load especially as in-situ-quantization only uses 1 core. (why is that anyway, is that a mistral.rs choice or is that set somewhere else?)