fastBPE icon indicating copy to clipboard operation
fastBPE copied to clipboard

Published 20 hours ago • verified publisher icon glample

Can fastBPE use the subword codes file?

Open SefaZeng opened this issue 2 years ago • 0 comments

I use the fastBPE to apply bpe to make it faster. But I want to use the origin codes file learned from subword. And I found a clean difference between the two results. Is it because fastBPE cannot use the codes file learned from subword?

SefaZeng avatar Nov 04 '21 07:11 SefaZeng