ai_book icon indicating copy to clipboard operation
ai_book copied to clipboard

Contrastive search for longer sequence decoding

Open YeonwooSung opened this issue 1 year ago • 0 comments

Contrastive search is originally proposed in "[A Contrastive Framework for Neural Text Generation"](Contrastive search is originally proposed in "A Contrastive Framework for Neural Text Generation") at NeurIPS 2022.

The contrastive search is well-known for text-generation for long sequence text data.

HuggingFace blog: Generating Human-level Text with Contrastive Search in Transformers

YeonwooSung avatar Jun 03 '23 15:06 YeonwooSung