Md. Erfanul Islam Bhuiyan comments

Repositories
Issues
Comments

Results 1 comments of


                                            Md. Erfanul Islam Bhuiyan

Docling-serve Fails to Utilize GPU Despite Available CUDA Provider

TL;DR: You need to Install **CUDA toolkit 12.8** for the image `docling-serve-cu128` to be able to enable CUDA accelaration. The `nvidia-smi` doesn't provide the information of which version of CUDA...