CUDA out of memory.

[Ragunath-planetre]

CUDA out of memory. Tried to allocate 67.61 GiB (GPU 0; 39.59 GiB total capacity; 3.17 GiB already allocated; 31.76 GiB free; 6.29 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation.

Am trying to process an image using 'timothybrooks/instruct-pix2pix' model and inference is set to 100. if i use images approx. 1MB in size am getting above issue in API endpoint. Is there any size limitation for the API endpoint?

if so, can this be increased?

[elvinagam]

looks like not maintained anymore @chenxwh