JusteLeo comments

Repositories
Issues
Comments

Results 3 comments of


                                            JusteLeo

feat: Python Backend Float16 Support for Turing GPUs

Would it be possible to also add support for the Pascal architecture? Even if the computation speed is slower (since int4 computation isn’t supported), could an on-the-fly conversion to Float16...

Feature Request: Can llama.cpp add support for DeepSeek OCR?

In case it helps, DeepSeek has shared the code for the VLLM implementation here: [DeepSeek OCR VLLM](https://github.com/deepseek-ai/DeepSeek-OCR/tree/main/DeepSeek-OCR-master/DeepSeek-OCR-vllm)

Feature Request: Can llama.cpp add support for DeepSeek OCR?

You’re both doing an exceptional job, well done! 🎉