High memory usage

[iamkhalidbashir]

Is this normal for 1 pdf file with 15 pages for vidore/colqwen2-v0.1 model

CUDA out of memory. Tried to allocate 59.39 GiB. GPU 0 has a total capacity of 23.55 GiB of which 11.38 GiB is free. Process 1712302 has 12.16 GiB memory in use. Of the allocated memory 11.25 GiB is allocated by PyTorch, and 473.74 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation.  See documentation for Memory Management  (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables)

btw I am using following command to encode

embeddings = RAG.model.encode_image(
        input_data=files_to_process,
)