jiant
jiant copied to clipboard
Replace `hacky_tokenization_matching` when Transformers tokenizers is available
(Documented as TODO in code.)