binmakeswell comments

Results 359 comments of


                                            binmakeswell

[feature] New example: MAE pretraining on ImageNet 1000 dataset

Pure DP MAE with colossal has been finished by https://github.com/lucasliunju/mae-colossalai

[feature] New example: MAE pretraining on ImageNet 1000 dataset

> > Hi @ofey404, thank you for your contribution! Would you please provide train logs in different parallelism settings? > > Several epochs or a full run? A full 800...

[enhancement] Examplify `all_reduce()` for tensor_parallel_*

Hi @ofey404 thank you for your contribution! @kurisusnowdeng Could you please help review this PR? Thanks.

Provide an Example for Inference

The feature depends on https://github.com/hpcaitech/ColossalAI/issues/256

Vision Transformer cifar10 bug

Hi @edwardhorp Thank you for your feedback, we have located the reason and are working on it. We will let you know once it is fixed!

ModuleNotFoundError: No module named 'colossal_layer_norm_cuda'

Hi @200987299 We have updated and simplified the installation process, and the example code has been updated. You can try to reinstall, thanks.

Any plan for Swin Transformer?

Hi @bityangke Hi, thanks for your advice. Swin Transformer is a famous work, we will provide it recently.

[FEATURE]: how to support codebases such as mmdetection as a distributed backend

Thank you for your feedback, we will consider providing it first in future version updates.

[DOC]: Change "Get Started" button on Home

Hi @groganz Thanks, we will update it soon.

[BUG]: stuck at initialization and no error message

Same bug at tp2pp4