Bhargav Solanki

### Question I managed to launch the webapp and the workers. I am not using the sglang servers (skipped then because i kept getting error preprocessing.json not found since I...

great work. But inference is too slow

5

Great work with this. The OCR is on latin text really good. Can you propose how to run this faster. i am already running it on a100 79GB using transformers,...

Support for deepseek v2

1

Can you please provide support for deepseek v2 deepseek-ai/DeepSeek-V2-Chat https://huggingface.co/deepseek-ai/DeepSeek-V2-Chat

### Motivation https://huggingface.co/google/paligemma-3b-pt-896 new model fromgoogle. Would be great to run it fat ### Related resources _No response_ ### Additional context _No response_