craft icon indicating copy to clipboard operation
craft copied to clipboard

Published 20 hours ago • verified publisher icon askerlee

Memory Question

Open S1aoXuan opened this issue 1 year ago • 2 comments

Hi, I was wondering what hardware device you are using? How much memory do I probably need to realize the training?

S1aoXuan avatar Mar 19 '24 12:03 S1aoXuan

Hi, I remember I was using RTX3090 (24GB) for this project. If your card has a smaller RAM, you can reduce the number of attention modes (the transformer is multi-mode as opposed to multi-head) to save RAMs.

askerlee avatar Mar 19 '24 12:03 askerlee

Thanks for the quick reply!

S1aoXuan avatar Mar 19 '24 13:03 S1aoXuan