swift-models icon indicating copy to clipboard operation
swift-models copied to clipboard

Published 20 hours ago • verified publisher icon tensorflow

Replace Vocabulary attributes with BijectiveDictionary

Open texasmichelle opened this issue 5 years ago • 0 comments

In Vocabulary, the attributes tokensToIds and idsToTokens are a good candidate for replacement with BijectiveDictionary. BERT and GPT2 both use Vocabulary, so ensure that functionality remains after the switch.

texasmichelle avatar Mar 13 '20 16:03 texasmichelle