Using with SpaCy 3.0

[elymatos]

Hi, Thanks for the good job! Is it possible to use these models with spaCy 3.0? Is there some recipe to this use? (actually the spaCy page about Transformers is not clear on how to train a new pipeline with models like these) Thanks!

[fabiocapsouza]

Hi @elymatos, I don't use spaCy so I can't help you unfortunately. But if spaCy supports BERT models of the Transformers library, it should work with BERTimbau, since the only difference are the weights. If that is the case, a tutorial for English BERT could give you directions.

I'll leave this issue open so others may comment here as well :)

[beeepaiva]

@fabiocapsouza Existe um package pro spaCy 3.0? Na versao espanhol por exemplo: Spanish transformer pipeline (dccuchile/bert-base-spanish-wwm-cased). https://huggingface.co/dccuchile/bert-base-spanish-wwm-cased e como import no spaCy teriamos nlp = spacy.load("es_dep_news_trf")

A forma desse package seria por conta do proprio spaCy ou já existe? Obrigada!!