transformer-pytorch icon indicating copy to clipboard operation
transformer-pytorch copied to clipboard

A PyTorch implementation of Transformer in "Attention is All You Need"

Results 3 transformer-pytorch issues
Sort by recently updated
recently updated
newest added

``` File "prepare_datasets.py", line 21, in translation_dataset = TranslationDataset(args.save_data_dir, 'train') File "/home/transformer-pytorch/datasets.py", line 56, in __init__ source, target = line.strip().split('\t') ValueError: not enough values to unpack (expected 2, got 1)...

Hi, If you (i'm guessing) have a more recent version of pytorch, then it seems that the expected input for index_select has changed? from recieving a tensorflout to a tensorlong....

Hi. Please i am very interested in your code and i would like to know how to extract weights for attention visualization. If possible how to do visualization. Your code...