Geekdream

Results 14 comments of Geekdream

> Thanks! This feature is very useful. But why not set `skip_existed` default to `True`? @genghisun Thanks! You are right and I have changed the default value to `True` in...

> Hi~ Sorry to bother you again. Today I realized that single file download also needs the `skip_existed` parameter, especially when downloading a list with multiple files, just like example...

same issue, how to train in a multi-node setting with launching with deepspeed?

I also tried other folders.. but all of them are failed to download completely. Always met the above error and the following error:

> Can you give an example link for me to reproduce? @wkentaro Thanks! `gdown --folder --remaining-ok https://drive.google.com/drive/folders/1cQYema_aW3I7n-B6Yvq6XGPBZamCZL14\?usp\=sharing`

It repeats to generate '\n' more frequently. ![Screenshot 2023-12-07 at 09 38 31](https://github.com/microsoft/DeepSpeedExamples/assets/52285873/790fa9d5-7873-450c-8f0b-2ae181b0e88f)

> 想问您一下,您把 --hybrid_engine_enabled参数去掉以后,训练速度是不是特别慢 @zjintheroom 是的,耗时增加了一倍