Nelson Yalta

Do you mean like using scheduler? Modifies the alpha (learning rate) during the training. You can use or implement one to affect the optimizer according your needs. https://pytorch.org/docs/stable/generated/torch.optim.lr_scheduler.StepLR.html#torch.optim.lr_scheduler.StepLR

Now, if you want to modify the weight of each loss independently, you will need to modify the ESPnet models of the corresponding task. For example, in ASR: https://github.com/espnet/espnet/blob/84b7a2fc7259feeb22e58499e2e90fead0d7e4c1/espnet2/asr/espnet_model.py#L204-L354 You...

The easy way: You can get the epoch from the reporter and forward it into the model. https://github.com/espnet/espnet/blob/84b7a2fc7259feeb22e58499e2e90fead0d7e4c1/espnet2/train/trainer.py#L587-L588 Another wat: Build a global config in espnet, and update it each...

If you check at https://github.com/espnet/espnet/blob/d3254133c595ea8271072ee49a1b4ceb3ed4fd7a/egs2/chime4/enh_asr1/conf/tuning/train_enh_asr_convtasnet_init_noenhloss_wavlm_transformer_init_lr1e-4_accum1_adam_specaug_bypass0.yaml#L3 you will see that the batch is 16 for an A6000 with 48GB. If you have a 24GB GPU, then you need to reduce to...

Could you share the whole `config.yaml` file? The training uses the `--fs` from run.sh and it should shown in the config.yaml` file.

What do you mean that is not same. Could you share the logs so we could look at the any error.

Mismatch between pth and onnx models are common, and could be larger depending on the language. Just in case, try to change the hyperparameters for decoding, such as beam size,...

I do not think that kind of details are enough. You need to modify the values in your config.yml file, and should be something like this: ``` beam_search: beam_size: 5...

@mmcauliffe I observe the same error when using conda + pip in version 2.2.15. It would be helpful to know where these programs belong, to which pip package/framework, so it...

@xenova thank you for your extraordinary work. @do-me I would like to know how did you connected to transformers using Vue. I am currently working on a project with Vue3,...