transformer-slt icon indicating copy to clipboard operation
transformer-slt copied to clipboard

Results mismatch from paper

Open hshreeshail opened this issue 2 years ago • 0 comments

I am assuming you used vanilla embeddings in your first ablation experiment on the number of encoder-decoder layers. Moreover, the paper states that it uses #layers=2 for further experiments. In that case, shouldn't the results in Table-3 (for #layers = 2) match the results in Table-5 (for vanilla embedding)? For example, the BLEU-4 score (for test set) in Table-3 is 21.65, and in Table-5, is 22.22. Shouldn't these not be different?

hshreeshail avatar Dec 05 '22 09:12 hshreeshail