ludwig
ludwig copied to clipboard
Torchtext undefined module when using gpt2bpe tokenizer
When trying to use the gpt2bpe tokenizer, I get an error that "module torchtext has no attribute util".
Fixed by adding
import torchtext.utils
import torchtext.transforms
to ludwig/utils/tokenizers.py
@jhudsy Would you like to create a pull request with your fix? Thanks a lot.
Hi @jhudsy could you try again with torchtext 0.17.2?