lightning-hydra-template icon indicating copy to clipboard operation
lightning-hydra-template copied to clipboard

How to skip the batch when OOM happens?

Open Xinheng-He opened this issue 5 months ago • 1 comments

Hi developers:

Hydra-lightning is a really cool tool and I like it! However, my batch includes highly different size of graphs and sometimes it causes OOM issues. Previously I would manually skip this batch but in hydra-lightning it seems hard to do this. Is it possible to add it in a future version, or how can I skip batch when such batch OOM (out of memory in GPU)?

Xinheng

Xinheng-He avatar Sep 06 '24 01:09 Xinheng-He