mistral.rs
mistral.rs copied to clipboard
Async channels
Closes https://github.com/EricLBuehler/mistral.rs/issues/235
Code Metrics Report
─────────────────────────────────────────────────────────────────────────────── Language Files Lines Blanks Comments Code Complexity ─────────────────────────────────────────────────────────────────────────────── Rust 70 23673 1557 511 21605 1311 ─────────────────────────────────────────────────────────────────────────────── Total 70 23673 1557 511 21605 1311 ─────────────────────────────────────────────────────────────────────────────── Estimated Cost to Develop 80,577 Estimated Schedule Effort 11.882489 months Estimated People Required 5.088453 ─────────────────────────────────────────────────────────────────────────────── Processed 782816 bytes, 0.783 megabytes (SI) ───────────────────────────────────────────────────────────────────────────────
I tested the server, interactive mode, quantized example, benchmark.
I think these cover all of the APIs?
@lucasavila00, thank you. Can you please test the Python bindings? It also seems like there are some more merge conflicts.
@EricLBuehler I fixed the conflitcts and tested the python api.
@lucasavila00 thank you!