MarCo-Dialog

MarCo-Dialog copied to clipboard

The Tokenizer takes the token ‘pricerange’ as ‘[UNK]’?

1

For example: tokens: ['i', 'am', 'looking', 'for', 'a', 'restaurant', 'in', 'the', '[restaurant_area]', '.', 'postcode', 'type', 'phone', 'food', 'pricerange', 'address', 'area', 'name', 'id', 'reference'] input_ids: [8, 35, 51, 15, 12, 45,...

HunYuanfeng

FileNotFoundError: [Errno 2] No such file or directory: 'data/train.tsv' Hello, could you put in the repo the tsv files or the scripts that allow users to generate them ? Thanks...

lpschaub