neuralforecast icon indicating copy to clipboard operation
neuralforecast copied to clipboard

Published 20 hours ago • verified publisher icon Nixtla

[FEAT] enable setting gpu optimization variables

Open jasminerienecker opened this issue 4 months ago • 4 comments

This is to allow adjusting the torch pin_memory and prefetch_factor variables to optimize gpu usage.

Note: by adjusting these variables I am now able to increase GPU usage to 95% whereas with just the num_workers variable that is currently exposed to the interface, GPU usage hovers around 40-60%.

jasminerienecker avatar Oct 21 '24 22:10 jasminerienecker