genie-toolkit
genie-toolkit copied to clipboard
The exact matcher does not work for Entity and Location parameters
You cannot quote those parameters, because if you quote them, they become QUOTED_STRING not Entity or Location. And you cannot just recognize them using the exact matcher.
The exact matcher should, when loading from the database, recognize the use of GENERIC_ENTITY_ and LOCATION_ tokens (which the tokenizer no longer produces), replace them with QUOTED_STRING_ and renumber.
(This applies to the part of the exact matcher that comes of the synthetic set. From Train Almond, we map it to a wildcard token in the trie so we have no problem)