deep_qa icon indicating copy to clipboard operation
deep_qa copied to clipboard

Allow tokenizers to insert begin and end tokens

Open matt-gardner opened this issue 7 years ago • 0 comments

So that if you want, you can represents words as character sequences like [@BEGIN@, w, o, r, d, @END@]. This is potentially helpful for various kinds of encoders (probably not BOW, but many others).

matt-gardner avatar Mar 24 '17 17:03 matt-gardner