blank_language_model

blank_language_model copied to clipboard

No such file or directory: 'checkpoints/yelp/neg/blm/lightning_logs/version_0/hparams.yaml' when testing the model on negative yelp.

1

Hi, I have sucessfully trained the model using: ``` python train.py --train data/yelp/train.0 --valid data/yelp/valid.0 --root_dir checkpoints/yelp/neg/blm/ \ --vocab_size 10000 --max_len 20 --model_type blm --share_emb_prj_weight --gpus 1 --max_steps 10 ```...

TalitaGroetzinger

Hi all, I was wondering what the benefits of sharing the word and projection weights when training a BLM model? Do you think/suggest using it as default hyper-param when training...

antonio-mastropaolo