pytorch-openai-transformer-lm
pytorch-openai-transformer-lm copied to clipboard
Implementation of Similarity Head
Similarity Head and Loss function were tested on the STS-B dataset, achieving nearly the same performance as reported (82.45% PC relative to the 82% in the paper). I can provide the necessary changed code for loading the dataset and reproducing my results if wanted.