fairseq

fairseq copied to clipboard

"OOM during optimization" when fine-tuning NLLB

10

## ❓ Questions and Help #### What is your question? Hi, I am getting "OOM during optimization, irrecoverable" when trying to fine-tune the 3.3B parameter NLLB model. ##### Stack trace:...

zgerrard

## ❓ Questions and Help ### Before asking: - [x] search the issues. - [x] search the docs. #### What is your question? I have extended FairseqDataset and created a...

sidharthrajaram

tfgridnet_integration

1

# Before submitting - [x] Was this discussed/approved via a Github issue? (no need for typos, doc improvements) - [x] Did you read the [contributor guideline](https://github.com/pytorch/fairseq/blob/main/CONTRIBUTING.md)? - [x] Did you...

pradumna-gautam

object of type 'NoneType' has no len()

2

(fairseq) dilip@dilip-Komplett-PC:/media/dilip/LaCie/Nitin/vakyansh-wav2vec2-experimentation/scripts/finetuning$ bash start_finetuning.sh ** Directory to code is: /media/dilip/LaCie/Nitin/vakyansh-wav2vec2-experimentation ** ** Config path is: /media/dilip/LaCie/Nitin/vakyansh-wav2vec2-experimentation/config/finetuning/ ** Data path is: /media/dilip/LaCie/Nitin/vakyansh-wav2vec2-experimentation/data/finetuning ** Checkpoint will be saved at: /media/dilip/LaCie/Nitin/vakyansh-wav2vec2-experimentation/checkpoints/finetuning ** Logs...

nitinyadav250

## 🚀 Feature Request When preparing `checkpoint_best.pt` and `checkpoint_last.pt`, create symbolic link instead of making exact copy of the checkpoint ### Motivation I'm running on a machine that somehow has...

ZeroRin

How to pre-train a multilingual HuBERT?

3

@wnhsu I am curious about the way to train a multilingual HuBERT as [this](https://github.com/facebookresearch/fairseq/blob/0338cdc3094ca7d29ff4d36d64791f7b4e4b5e6e/examples/speech_to_speech/docs/textless_s2st_real_data.md?plain=1#L10). And, can I just continue to pre-train HuBERT on another language by loading the original HuBERT...

tarudesu

I'm attempting to reproduce some results from the Data2Vec 2.0 paper, specifically the audio task results. I'm using the recommended commands from the Data2Vec 2.0 readme. Specifically, I've downloaded the...

Addison-Weatherhead

Stuck an afternoon almost.... i was using lightseq to accerlate fairseq.it support fairseq0.10.2,and i want to keep my fairseq0.12.2. so when running lightseq's criterion's init,error bumped:'TranslationTask' object has no attribute...

whiteSteelRain

Addition dot in translated text

1

## ❓ Questions and Help #### What is your question? For some english words, the model add `.` to the end of translation ; for example: `ok`. See the code...

gosha70

# Before submitting - [+] Was this discussed/approved via a Github issue? (no need for typos, doc improvements) - [+] Did you read the [contributor guideline](https://github.com/pytorch/fairseq/blob/main/CONTRIBUTING.md)? - [+] Did you...

oty-v