Transformers.jl
Transformers.jl copied to clipboard
Support for HuggingFace bert-base-portuguese-cased
Is it possible to support the neuralmind/bert-base-portuguese-cased
? We are doing lots of portuguese NLP and this custom BERT model has better performance in our portuguese NLP problems.
Cc'ing a collaborator @RosalRicardo
I also wish to have the portuguese models available in Julia. Is there any plan to add those? Or a tutorial where we can transform them by ourselves?
I tried to use the Transformers.BidirectionalEncoder.tfckpt2bson but it needs TensorFlow.jl
installed, a package that is not maintained anymore and not compatible with Windows:
Yes, that's on the plan (#83). I'm currently working on fixing the hugginface part so that would be supported in near future. Also the tfckpt2bson
would eventually be removed.