Che Liu comments

Repositories
Issues
Comments

Results 3 comments of


                                            Che Liu

modify the entropy function be able to compute vectorizly

> Thanks for reply! I will try my best and upload the code for review. I will start with the perm_entropy and several entrop calculation function.

8卡主不动了，4卡没问题，请问原因是？

您好，请问 > [03/07/24 14:50:30] INFO colossalai - colossalai - INFO: train.py:155 main INFO colossalai - colossalai - INFO: Dataset contains 105060 samples [03/07/24 14:52:00] INFO colossalai - colossalai - INFO:...

8卡主不动了，4卡没问题，请问原因是？

> 另外补充，GPU利用率长时间是0。但是我从DiT-XL/2 改成 DiT-XL/8 就不卡了，看来是显存炸了您好多谢您的回复。请问一下这个dit xl 2/8指的是模型里什么部分的参数呢，我设置的2还以为会比8小