Shaker Islam comments

Repositories
Issues
Comments

Results 11 comments of


                                            Shaker Islam

Using metal and `n_gpu_layers` produces no tokens

llama-cpp-python requires the user to specify `CMAKE_ARGS` when during `pip install`: https://llama-cpp-python.readthedocs.io/en/latest/install/macos/ Do users need to do something similar during `cargo install` for this crate?