Maurice Weber

Bug when running inference with retrieval augmented model

1

**Describe the bug** Using retrieval-augmented models, a sequence of prompts leads to a runtime error (size mismatch between two tensors). **To Reproduce** Steps to reproduce the behavior: 1. After downloading...

This should fix issue #14 : - rename wikipedia to wiki - add data_dir as args - minor readability improvements

## Current State Currently the data in the commoncrawl slice contains the following fields in addition to the `text` field: ``` "pred_label": "__label__cc", "pred_label_prob": XXX, "wiki_prob": XXX, "source": "cc/2019-30/en_middle_0053.json.gz/line1" ```...

remove flags in the code snippet in step 2