ABSADatasets icon indicating copy to clipboard operation
ABSADatasets copied to clipboard

Mislabelled polarities relative to original datasets

Open asmith-wowcorp opened this issue 1 year ago • 1 comments

I was curious because there seemed like many mis-labelled examples in the acos datasets, so I compared one I found with another source for the dataset. In InstructABSA repo, I can see: image

whereas in this repo the second sentiment for that comment is positive: https://github.com/yangheng95/ABSADatasets/blob/v2.0/datasets/acos_datasets/504.Restaurant16/rest16_quad_train.tsv.txt

image

It has me bit worried about using this source :-/. Any idea what is going on?

asmith-wowcorp avatar Jan 02 '25 07:01 asmith-wowcorp

It looks like the source of the ACOS annotations is here: https://github.com/NUSTM/ACOS/tree/main which has the wrong polarity already

asmith-wowcorp avatar Jan 03 '25 00:01 asmith-wowcorp