Haowei Wu comments

Results 6 comments of


                                            Haowei Wu

Feature Request: Can llama.cpp add support for DeepSeek OCR?

I'd be happy to help if no one else is working on it (I'm looking to deploy it on my server as well haha)

Feature Request: Can llama.cpp add support for DeepSeek OCR?

@MaoJianwei actually I am working on it. this might take a while.

Feature Request: Can llama.cpp add support for DeepSeek OCR?

@sfallah I read your code and I'm at a similar place with this. SAM's local attention requires ggml_win_part & ggml_win_unpart operations for the 14x14 window partitioning, and it also requires...

Feature Request: Can llama.cpp add support for DeepSeek OCR?

@sfallah Yes, please give me write access. I'll move my code to your branch. Edit: I've already debugged your convert_hf_to_gguf.py script and got it working for the vision model. Ready...

Feature Request: Can llama.cpp add support for DeepSeek OCR?

@createthis It will support CUDA backend (and hopefully other major backends as well). It looks like there's a way to work around the limitation I said earlier. @wenerme thx I'll...

Feature Request: Can llama.cpp add support for DeepSeek OCR?

🎉Good news: We just finished a functional implementation of DeepSeek-OCR for llama.cpp! While it's still imperfect and currently only supports Base mode (1024 x 1024) in CPU backend, @sfallah and...