Hardware Requirements

[cfchi]

Hi, I'm curious about the hardware requirements for the experiment. I've been using a 4090 GPU with 128GB of VRAM to run the prune_finetune.py script on the Garden dataset. However, I'm encountering out-of-memory errors when setting the iteration to 5000. What sort of hardware specifications would be necessary to achieve training quality comparable to the standards outlined in the paper? Thanks!