multifit
multifit copied to clipboard
n-waves
The code to reproduce results from paper "MultiFiT: Efficient Multi-lingual Language Model Fine-tuning" https://arxiv.org/abs/1909.04761
Hi I was wondering if there's an attempt to update this codebase to fastai 2. I'm trying to run that on updated libraries but it seems trickier than I anticipated.
In your `README.md` is explained how to create a language model that can be used in fastai: ```python from fastai.text import * import multifit exp = multifit.from_pretrained("name of the model")...
Hello, I've seen your code at the front page for training a language model ``` `from fastai.text import * import multifit exp = multifit.from_pretrained("name of the model") fa_config = exp.pretrain_lm.tokenizer.get_fastai_config(add_open_file_processor=True)...
Hi, I want to ask a question ,if i want to use model that trained in English,and use it to test other languages.How do I run the code?
I tried to use MultiFit project for Persian language (with fa abbreviation)… when it’s used with fa_2 folder, I can run the trainer, but for fa_100 which is a larger...
When I execute a python script via jupyter notebook I recieve the following error: ``` ~/miniconda3/lib/python3.7/site-packages/fastai/text/data.py in train_sentencepiece(texts, path, pre_rules, post_rules, vocab_sz, max_vocab_sz, model_type, max_sentence_len, lang, char_coverage, tmp_dir, enc) 434...
I have successfully used Multifit for a while now. Thanks for sharing! I would like to use Multifit with fp16. I used a pretrained language model (paperversion fp32) and followed...
I'm training a language model similar to what has been shown here https://github.com/n-waves/multifit/blob/master/notebooks/CLS-JA.ipynb While running `cls_dataset.load_clas_databunch(bs=exp.finetune_lm.bs).show_batch()` I'm getting this output > Running tokenization: 'lm-notst' ... > Validation set not found...
Hi, Thank you for sharing your repo. I am trying to finetune a LM with multifit on custom dataset and then finetune the classifier for prediction. Unfortunately I got an...
prepare_cls.py: Could you share public URL to fetch cls books/music in german version please ?? def fetch_cls(url_prefix, cls_path="data/cls"): """ Fetch CLS from server using basic auth url_prefix should point to...
