TextModels.jl icon indicating copy to clipboard operation
TextModels.jl copied to clipboard

Moving ALBERT PR from TextAnalysis.jl [WIP]

Open tejasvaidhyadev opened this issue 3 years ago • 0 comments

Dependencies

  • Transformers.jl , WordTokenizer.jl

Pretrained weights .

  • The pretrained weights are converted from the TensorFlow checkpoint released by google-research.
  • The code for conversion is given in tfckpt2bsonforalbert.jl
  • Currently, Pretrained weight for Version-1 is given soon I will release it for version-2

For detail refer - link

Demo - link

tejasvaidhyadev avatar Jul 15 '21 19:07 tejasvaidhyadev