SimCSE icon indicating copy to clipboard operation
SimCSE copied to clipboard

The results of the evaluation phase are not exactly in line with yours

Open Moximixi opened this issue 3 years ago • 0 comments

The command is exactly as the following example, only the model_name_or_path is changed

python evaluation.py \
    --model_name_or_path princeton-nlp/sup-simcse-bert-base-uncased \
    --pooler cls \
    --task_set sts \
    --mode test

The rightmost column is the result of my Evaluation, why some results are the same and some are different? image

Moximixi avatar Oct 12 '22 07:10 Moximixi