nobuco icon indicating copy to clipboard operation
nobuco copied to clipboard

Extremely High GPU VRAM Usage During Conversion

Open chadrockey opened this issue 6 months ago • 1 comments

I've observed an issue where occasionally my VM sessions will crash and I tracked it down to VRAM usage during the conversion.

Here is a typical amount of VRAM usage: Screenshot 2024-08-01 at 12 25 03 AM

And here is the jump when the conversion begins: Screenshot 2024-08-01 at 12 28 53 AM

I was able to avoid this by adding this before the conversion. Then the VRAM isn't increased and even the normal ram isn't increased at all.

    import tensorflow as tf
    tf.config.experimental.set_visible_devices([], 'GPU')

chadrockey avatar Aug 01 '24 05:08 chadrockey