Peter Plantinga
Peter Plantinga
> Shouldn't we just extend this to all `torch.load` calls that are not only used for loading weights? I don't know if there's an easy way of knowing which is...
I have updated the `main` and `DASB` branch to address the CI failures due to a github change, merging the upstream DASB into this branch should make the CI run...
I have updated the `main` and `DASB` branch to address the CI failures due to a github change, merging the upstream DASB into this branch should make this CI run...
I have updated the `main` and `DASB` branch to address the CI failures due to a github change, but unfortunately that caused a conflict here. Let me know if you...
Its not as easy as I thought to move sentencepiece to extra requirements slash integrations because many of our inference models depend on it. One alternative is a community build...
Perhaps another alternative is to convert our sentencepiece models to `tokenizers` a la https://github.com/huggingface/transformers/issues/25316