alonkonchitsky12345

Results 2 issues of alonkonchitsky12345

### Search before asking - [x] I have searched the HUB [issues](https://github.com/ultralytics/hub/issues) and [discussions](https://github.com/ultralytics/hub/discussions) and found no similar questions. ### Question I would like to use the “RMSprop” optimizer, when...

question
detect

How to train a TinyLlama-like model using FSDP, qLoRa on two (or more) nodes if each node has one (or more) GPU using train.py (main branch) ? I am grateful...