cokuehuang

Finetuning NLLB models with error "ValueError: --share-all-embeddings requires a joined dictionary", need help!

3

## ❓ Questions and Help I want to test finetuning nllb models(3.3B) , I followed the doc in [Finetuning NLLB models](https://github.com/facebookresearch/fairseq/tree/nllb/examples/nllb/modeling) with this command: `python fairseq/examples/nllb/modeling/train/train_script.py \ cfg=nllb200_dense3.3B_finetune_on_fbseed \ cfg/dataset=fairseq/examples/nllb/modeling/train/conf/cfg/dataset/fbseed_chat.yaml...

How to inference based on export_hf result?

6

Results with export_hf_checkpoint.py: ├── config.json ├── generation_config.json ├── pytorch_model-00001-of-00007.bin ├── pytorch_model-00002-of-00007.bin ├── pytorch_model-00003-of-00007.bin ├── pytorch_model-00004-of-00007.bin ├── pytorch_model-00005-of-00007.bin ├── pytorch_model-00006-of-00007.bin ├── pytorch_model-00007-of-00007.bin └── pytorch_model.bin.index.json While convert llama to hf format as...

I want to test the speed of easyocr, this is my script: `import easyocr import time reader_ar = easyocr.Reader(['ar'], gpu=True) while True: st=time.time() result = reader_ar.readtext('a.jpg', detail=0, paragraph=True) print(result) et=time.time()...

Much more memory used in step 3 when using multi gpus compared to using single gpu

5

**System Info:** Memory: 500G GPU: 8 * A100 80G Question: **Why using multi gpus in init of DeepSpeedRLHFEngine used much more memroy compared to using single gpu ?** **Reproduce:** Copy...