minbpe
minbpe copied to clipboard
Handle error when running out of pairs to merge
Accidentally encountered a ValueError: max() arg is an empty sequence
when attempting to test on a small piece of text with a (maybe) large vocab_size
.