Karan Purohit

Pretraining of albert from scratch is stuck

8

I am doing pre-training from scratch. It seems that training is started as gpu's are being used but nothing is on terminal except this: ``` ***** Number of cores used...

I have generated pretraining data using the given steps in this repo. I am doing this for the Hindi language with 22gb of data. Generating pretraining data itself took 1...

Not able to load encoder

6

getting error while loading encoder: `m3.load_encoder(f'adam1_enc')` ``` python RuntimeError Traceback (most recent call last) ~/anaconda2/envs/fastai/lib/python3.6/site-packages/torch/nn/modules/module.py in load_state_dict(self, state_dict, strict) 513 try: --> 514 own_state[name].copy_(param) 515 except Exception: RuntimeError: invalid argument...

model loading issue

21

I am using pre-trained model to get the embedding but getting below error: ``` RuntimeError Traceback (most recent call last) in 2 import torchaudio 3 ----> 4 wav2mel = torch.jit.load("wav2mel.pt")...

Getting huge number of training steps

5

I have generated pretraining data using [https://github.com/kamalkraj/ALBERT-TF2.0](url) because this supports training with multi GPU. I am doing this for the Hindi language with 22gb of data. Generating pretraining data itself...

cant start training

37

I was testing the setup on mini librispeech data .This is log when I started training ``` # train.py -c conf/train.yaml data/simu/data/train_clean_5_ns2_beta2_500 data/simu/data/dev_clean_2_ns2_beta2_500 exp/diarize/model/train_clean_5_ns2_beta2_500.dev_clean_2_ns2_beta2_500.train # Started at Thu Dec 5...

first of all good job on this repo @monologg ! I facing difficulty in getting confidence of each predicted entity. I am able to get confidence for each intent. Not...

Issue while generating pre training data

15

I am generating pre training data for hindi, I am using sentence piece vocab for it. Getting the following error. ``` python build_pretraining_dataset.py --corpus-dir data --vocab-file spie ce.vocab --output-dir out...

Is there multi-gpu suport?

2

Have checked official repo but thats on single gpu. Do this Repo provide multi-gpu support?

No such file or directory: 'data/viton_test_pairs.txt'

4

Getting error in test stage1. `loading model from checkpoint model/stage1/model-15000 INFO:tensorflow:Restoring parameters from model/stage1/model-15000 Traceback (most recent call last): File "model_zalando_mask_content_test.py", line 236, in tf.app.run() File "/home/gamut/.conda/envs/tf_3/lib/python3.6/site-packages/tensorflow/python/platform/app.py", line 125, in...