dino icon indicating copy to clipboard operation
dino copied to clipboard

Nothing comes out when using GPT-3

Open chansonzhang opened this issue 3 years ago • 1 comments

My command:

python dino.py --output_dir=. --task_file=task_specs/sts-x2.json --input_file=input.txt --input_file_type=plain --num_entries_per_input_and_label=3 --model_name=davinci --openai_api_key=<open_api_key>

The output is:

Done loading 1 inputs from file 'input.txt'
Using OpenAI's GPT3 (davinci) as generator. The following parameters are ignored: ['decay_constant', 'top_k']
Starting dataset generation with DINO...
Dataset Entries: 100%|██████████| 1/1 [00:09<00:00,  9.84s/it]
Dataset generation complete, dataset contains 0 entries
Done saving dataset to file '.\sts-dataset.jsonl'

But we I look into sts-dataset.jsonl, it's empty.

P.S. when I use gpt-2 model in my local machine, everything is ok.

chansonzhang avatar May 19 '22 06:05 chansonzhang

Seems davinci haven't generated sentence with " as a EOS, when I add --keep_outputs_without_eos flag, everything is OK.

chansonzhang avatar May 19 '22 07:05 chansonzhang