Daisy Deng comments

Repositories
Issues
Comments

Results 4 comments of


                                            Daisy Deng

The tokenizer add_special_tokens parameter for t5 model lambada task

Hi @StellaAthena, the ppl and accuracy of google/flan-t5-xl on lambada I got with add_special_tokens=False is | Task |Version|Metric| Value | |Stderr | |--------------|------:|------|-------:|---|------:| |lambada_openai| 0|ppl |360.4850|± |28.7851| | | |acc...

The tokenizer add_special_tokens parameter for t5 model lambada task

Thanks @StellaAthena, do you mean to call generate and check the output? I will have a try. I also sent an email to t5 author, hope we can get a...

The tokenizer add_special_tokens parameter for t5 model lambada task

Checked with google/flan-t5-xl author, the recommended way to run lambada on this model is to append EOS at the end of input and targets in _model_call(), while when we compute...

[WIP][xpu][test] [1/N] Enable missing Intel GPU inductor tests

@pytorchbot drci