Weird parsing by PropS wrapper

[kleinay]

I encountered this example - its about tweet 258907583165911040 from boy_scouts:

{'Entities': {'A1': ('Released', (10,)), 'A2': ('Perversion Files Set', (4, 6, 7)), 'A3': ('Released', (22,)), 'A4': ('Perversion Files Set', (16, 18, 19))}, 'Predicates': {'P1': {'Arguments': ['A1', 'A2'], 'Bare predicate': ('To Be', (8, 9)), 'Head': {'Lemma': 'Be', 'POS': 'VB', 'Surface': ('Be', [9])}, 'Template': '{A2} To Be {A1}'}, 'P2': {'Arguments': ['A3', 'A4', 'A2'], 'Bare predicate': ('To Be', (20, 21)), 'Head': {'Lemma': 'Be', 'POS': 'VB', 'Surface': ('Be', [21])}, 'Template': '{A2} {A4} To Be {A3}'}}, 'Sentence': "Boy Scouts ' Perversion ' Files Set To Be Released : Boy Scouts ' Perversion ' Files Set To Be Released"}

Note P2 template - Why is A2 also there?

[gabrielStanovsky]

I'm not sure what's going on in the input sentence. Is it: Boy Scouts ' Perversion ' Files Set To Be Released : Boy Scouts ' Perversion ' Files Set To Be Released

Seems to be repeating information, right?

In that case, proposition P2 is (arguments in brackets): [Perversion Files Set] [Perversion Files Set] To Be [Released]

Which doesn't seem too far off. My guess is that the parser gets confused due to the weird sentence structure.

[kleinay]

Yes, That is the sentence, and it is indeed confusing for the parser. I think we better find a way to handle these duplicated sentences, if possible. Maybe at the preprocessing stage.

[gabrielStanovsky]

Is that something that happens often? I think that if we handle this, then it should be handled in a separate cleaning stage (with e.g. #18).