Bhavnick Minhas

Hi @michaelbenayoun! Is someone working on adding the Pegasus ONNX config? If not, I would like to look into it 😄(under your guidance, since I haven't done written a ONNXConfig...

@fxmarty Still facing an issue > Hi @bhavnicksm , @mht-sharma just merged the Pegasus ONNX config yesterday! https://github.com/huggingface/optimum/pull/620 I installed optimum directly from source here using ```python !pip install --quiet...

Encountered the same issue! Trying to train a distilbert model on squad with the following code: ``` CUDA_VISIBLE_DEVICES=0 python3 ./transformers/examples/pytorch/question-answering/run_qa.py \ --model_name_or_path distilbert-base-cased \ --run_name distilbert-base-cased-squad-008 \ --dataset_name squad_v2 \...

Encountered the same issue! Training OPT-125M with bnb on summarization.

Thanks @pacman100! I am trying out the same script with 6.7B OPT right now. Hopefully, this would show a significant training time difference.