word2box icon indicating copy to clipboard operation
word2box copied to clipboard

Unable to train Word2Box: the script gives error messages

Open ChiaraBi opened this issue 1 year ago • 0 comments

Hi, I am trying to train the model Word2Box using the following command:

language-modeling-with-boxes train \
 --model_type Word2Box \
 --int_temp 0.0 \
 --loss_fn nce \
 --box_type BoxTensor \
 --dataset ptb \
 --num_epochs 2 --log_frequency 10 
  • If int_temp != 0.0 (I am using the default value 0.01), it gives the following error message: "Gumbel intersection is not possible".
  • If int_temp == 0.0, it gives the following error message: "The size of tensor a (681) must match the size of tensor b (8) at non-singleton dimension 1".

What value should I use for int_temp to make the script work? Is there any other parameter I need to use?

Thank you in advance!

ChiaraBi avatar Feb 04 '24 16:02 ChiaraBi