jichan3751

Possible wrong implementation in loralib layers

1

Hi, In loralib's layer modules, https://github.com/microsoft/LoRA/blob/33b953630763c6299d2349abc8f154a3951a7984/loralib/layers.py#L138 It seems like `eval() `function which merges W+BA is never called. This is because when changing the model to evaluation mode in torch by...

Validation set loss exploding for baseline realNVP training with CIFAR10

1

Hi, I'm running baseline realNVP training with CIFAR10 with following command: ``` python3 train_unsup.py --dataset=CIFAR10 --data_path=DATA_PATH --logdir=LOG_DIR \ --ckptdir=CKPTS_DIR --num_epochs=101 --lr=1e-4 --batch_size=32 --num_blocks=8 \ --weight_decay=5e-5 --num_scales=3 ``` I'm printing out...