dex-lang icon indicating copy to clipboard operation
dex-lang copied to clipboard
verified publisher icon google-research

Add multisets

Open duvenaud opened this issue 2 years ago • 1 comments

This is another step towards writing a tokenizer demo in Dex. Multisets let us find all the unique words in a corpus along with their counts in parallel.

duvenaud avatar Aug 22 '23 15:08 duvenaud

Just noting that the Dex tests all pass now. Something is broken with the jax python tests independent of this PR.

duvenaud-anthro avatar Aug 22 '23 20:08 duvenaud-anthro