Questions about GPU requirements and usage

[SlenderMongoose]

Thank you for sharing your code and detailed documentation. I am currently using your code and have encountered a few questions regarding the GPU usage.

1. What is the approximate GPU memory requirement for fine-tuning？
2. Is it possible to train the model using a single GPU? If so, what settings should I be aware of?
3. I am currently using multiple RTX 3090 GPUs but encountering out-of-memory (OOM) errors. Is there any way to resolve this issue? If so, how should I set it up?
4. Interestingly, I can successfully run test.py using a single RTX 3090 GPU, but it fails with multiple RTX 3090 GPUs. Do you have any suggestions on how to resolve this?

Thank you very much for your time and assistance!