GPU cuda implementation

[123LiVo321]

I'm very sorry for my ignorance, but apparently I'm not doing well with a very basic matter. I can't setup gpu-cuda. I tried different writing options in marker/settings.py:

TORCH_DEVICE=cuda
# TORCH_DEVICE: Optional[str] = None

or TORCH_DEVICE: Optional[str] = cuda

together with

INFERENCE_RAM=16
# INFERENCE_RAM: int = 40

or INFERENCE_RAM: int = 16

all 4 combinations, but i still get:

Loaded detection model vikp/surya_det2 on device cpu with dtype torch.float32 Loaded detection model vikp/surya_layout2 on device cpu with dtype torch.float32 Loaded reading order model vikp/surya_order on device cpu with dtype torch.float32 Loaded recognition model vikp/surya_rec on device cpu with dtype torch.float32 Loaded texify model to cpu with torch.float32 dtype

cpu on 100% , nothing on the side of GPU usage or memmory. I do have 4060ti / 16gb and using torch with gpu in other applications...

Would someone be kind enough to explain to the noob where he is making a mistake?