faster-whisper icon indicating copy to clipboard operation
faster-whisper copied to clipboard

Release the model from VRAM

Open yumianhuli1 opened this issue 1 year ago • 0 comments

I tried to clean the faster whisper model from the VRAM for use by other module. I del the fasterWhisper_Transcriber object and torch.cuda.empty_cache(), but there was always 200-300M of memory left uncleaned

yumianhuli1 avatar Feb 12 '24 11:02 yumianhuli1