TextModels.jl
TextModels.jl copied to clipboard
Moving ALBERT PR from TextAnalysis.jl [WIP]
Dependencies
- Transformers.jl , WordTokenizer.jl
- The pretrained weights are converted from the TensorFlow checkpoint released by google-research.
- The code for conversion is given in
tfckpt2bsonforalbert.jl
- Currently, Pretrained weight for Version-1 is given soon I will release it for version-2
For detail refer - link
Demo - link