zaocan666

NaN error

3

Hi, excellent work here. I encountered NaN error when training with the config configs/train_mf_gan64d_april.config: `Traceback (most recent call last): File "/home/urkax/project/GenFed/manifold-flow-public/experiments/train.py", line 592, in learning_curves = train_model(args, dataset, model, simulator)...

doubt about patch embeddings

4

Hi~awsome repo. But I wonder if it is necessary to implement GELU and LayerNorm after linear layer to get patch embedding. Neither the ViT paper and code applies these layers....