RAM issue: MPS backend out of memory

[davidkamp]

Hi, I am running AUDIOLDM2 on a M1 macbook air with 16GB of Ram on Ventura 13.5.

On my second test I ran out of memory quickly: RuntimeError: MPS backend out of memory (MPS allocated: 18.02 GB, other allocations: 107.10 MB, max allowed: 18.13 GB). Tried to allocate 4.50 MB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure).

Is there any way to prevent this, especially when using the inputtext list option?

Is there a workaround or trick to keep this from crashing on my machine?

Thank you!