donut icon indicating copy to clipboard operation
donut copied to clipboard

inference speed is very slow on cpu for docvqa task and CUDA out of memory

Open roburst2 opened this issue 2 years ago • 0 comments

it is taking almost 300 sec for single question on CPU

on gpu i am getting cuda out of memory below are the configuration

NVIDIA GeForce RTX 2080 Ti memory 11264 MiB

roburst2 avatar Sep 29 '22 13:09 roburst2