Transformers.jl icon indicating copy to clipboard operation
Transformers.jl copied to clipboard

Support for HuggingFace bert-base-portuguese-cased

Open storopoli opened this issue 3 years ago • 2 comments

Is it possible to support the neuralmind/bert-base-portuguese-cased? We are doing lots of portuguese NLP and this custom BERT model has better performance in our portuguese NLP problems.

Cc'ing a collaborator @RosalRicardo

storopoli avatar Oct 11 '21 18:10 storopoli

I also wish to have the portuguese models available in Julia. Is there any plan to add those? Or a tutorial where we can transform them by ourselves?

I tried to use the Transformers.BidirectionalEncoder.tfckpt2bson but it needs TensorFlow.jl installed, a package that is not maintained anymore and not compatible with Windows:

image

dcecchini avatar Jun 21 '22 15:06 dcecchini

Yes, that's on the plan (#83). I'm currently working on fixing the hugginface part so that would be supported in near future. Also the tfckpt2bson would eventually be removed.

chengchingwen avatar Jun 21 '22 19:06 chengchingwen