transformer-pytorch icon indicating copy to clipboard operation
transformer-pytorch copied to clipboard

Dataset Preparation Error

Open Kojo7 opened this issue 3 years ago • 0 comments

  File "prepare_datasets.py", line 21, in <module>
    translation_dataset = TranslationDataset(args.save_data_dir, 'train')
  File "/home/transformer-pytorch/datasets.py", line 56, in __init__
    source, target = line.strip().split('\t')
ValueError: not enough values to unpack (expected 2, got 1)

I get this error above even though I have the datasets in the right formats;

  • src-train.txt
  • tgt-train.txt
  • src-val.txt
  • tgt-val.txt

Is there something I'm doing wrong, help please.

Thanks

Kojo7 avatar Sep 12 '21 12:09 Kojo7