Jiaaochen comments

Repositories
Issues
Comments

Results 5 comments of


                                            Jiaaochen

minor bug fixes

Thanks for the note, we will push the updated version.

AttributeError: 'BertConfig' object has no attribute 'chunk_size_feed_forward'

I used a pretty old version of transformers, which is pytorch_transformers. I think that should be the initial version of the current transformers package.

KeyError: unlabeled_train_iter.next()

This might be related to the dictionary file about the back-translations. This might be because several sentences are not back-translated, like the 9226th sentence.

Finetune LLAMA-65B using LoRA

Thanks for the suggestions!

Finetune LLAMA-65B using LoRA

Is it possible to lora finetune 65B model on 8 V100(32GB)?