ml-explore
C++ API examples
Could you please add a few examples on how one could consume c++ API ? Especially how one could use them with Rust ?
Our entire production system is based on rust. We would love if you could give us any pointers on this.
Yes there are a few examples in the core repo. We don't have a higher level nn API in C++ yet. That's on the TODO list.
Is that the kind of thing you are looking for? If not could you be more specific?
A simple example of running 16/8bit llama inference through c++ api should be sufficient. I can then review how I can use it through rust.
On Mon, 18 Dec 2023 at 2:45 AM, Awni Hannun @.***> wrote:
Yes there are a few examples in the core repo https://github.com/ml-explore/mlx/tree/main/examples/cpp. We don't have a higher level nn API in C++ yet. That's on the TODO list.
Is that the kind of thing you are looking for? If not could you be more specific?
— Reply to this email directly, view it on GitHub https://github.com/ml-explore/mlx-examples/issues/128#issuecomment-1859286467, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAXGU4EV6KVW2TD6A6PQGQ3YJ5OGXAVCNFSM6AAAAABAYRIVJSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNJZGI4DMNBWG4 . You are receiving this because you authored the thread.Message ID: @.***>