Cospui comments

Repositories
Issues
Comments

Results 3 comments of


                                            Cospui

Can't run the run.py file even after installing the dependencies required.(Windows)

I have the same problem too.

Results of Google Colab's example

I also encountered this problem. It seems to be caused by bad initialization and sampling or ReLU so the training is stuck in local optima. Changing the seed (e.g., uncomment...

Device error on 0.0.27.dev844

Thanks for your reply. As for the attention bias, I use ``` attn_bias, x = xformers.ops.fmha.BlockDiagonalMask.from_tensor_list(x) attn_bias = attn_bias.make_causal() ``` I set ```model.to(device)``` in each rank, but I did not...