RL4LMs icon indicating copy to clipboard operation
RL4LMs copied to clipboard

Published 20 hours ago • verified publisher icon allenai

BART supervised

Open talent404 opened this issue 2 years ago • 2 comments

I have tried using BART as a seq2seq type model, from huggingface facebook/bart-large. This howerver throws an error saying that .parallelise doesnt exit. Has anyone been able to finetune bart using this repo?

talent404 avatar Nov 04 '22 06:11 talent404

@talent404 This is a known issue. We have a PR coming up to fallback to data parallel when model parallel is not available. I will keep you posted.

rajcscw avatar Nov 04 '22 07:11 rajcscw

Is the error message AttributeError: 'BartForConditionalGeneration' object has no attribute 'encoder' related to this? That's what I get when trying to finetune bart.

keeganstoner avatar Dec 21 '22 20:12 keeganstoner