Whisper-WebUI icon indicating copy to clipboard operation
Whisper-WebUI copied to clipboard

Published 20 hours ago • verified publisher icon jhj0517

GPU memory overflow in ROCm environment

Open labeldock opened this issue 11 months ago • 3 comments

I'm looking for an option to release GPU memory after Whisper tasks. Sometimes my PC shuts down due to overflowing GPU memory. Running on Debian(Bookworm) + Docker(rocm/pytorch:rocm6.0.2_ubuntu22.04_py3.10_pytorch_2.1.2) + RX6800

I am aware that there is no official support for Linux or Docker environments. However, I believe that supporting these options would definitely have a positive impact in the future.

  • Free GPU memory immediately after GENERATE SUBTITLE is finished
  • Free GPU memory if it is not used for a certain period after GENERATE SUBTITLE is finished

I have no experience with Python, pytorch, etc., so my ability to interpret the project is limited. If could determine whether the feature implementation is possible, I will try to contribute in any way I can.

labeldock avatar Apr 04 '24 05:04 labeldock