twembeddings icon indicating copy to clipboard operation
twembeddings copied to clipboard

Published 20 hours ago • verified publisher icon ina-foss

[rust] take past vocabulary

Open bmaz opened this issue 3 years ago • 0 comments

  • [ ] add a token in the vocab file containing the total size of the vocabulary
  • [x] add an option in the vocab command allowing to pass another vocabulary

bmaz avatar Jun 15 '21 14:06 bmaz