ROCm

[etemiz]

Thanks for this amazing software!

Is there a possibility to run it or surya using ROCm / AMD GPUs?

Thanks again

[etemiz]

I found it:

pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/rocm6.0
pip install marker-pdf

[mxchinegod]

@etemiz are you seeing models load into VRAM i.e. using 7900XTX and ROCm 6.0, I'm only seeing

Loaded detection model vikp/surya_det2 on device cpu with dtype torch.float32
Loaded detection model vikp/surya_layout2 on device cpu with dtype torch.float32
Loaded reading order model vikp/surya_order on device cpu with dtype torch.float32
Loaded recognition model vikp/surya_rec on device cpu with dtype torch.float32
Loaded texify model to cpu with torch.float32 dtype

I was looking into adding ROCm support in PR but if you have it working already I wonder what I am doing incorrectly.

[etemiz]

Yes I see them in the VRAM.