George Baker issues

Results 4 issues of


                                            George Baker

Infinite loss when fine-tuning

I'm trying to fine-tune the AMR3.0 large SBART checkpoint on another dataset, but during training I get the following warnings: ``` 2023-04-29 00:02:05 | WARNING | tensorboardX.x2num | NaN or...

loaded state dict contains a parameter group that doesn't match the size of optimizer's group

When trying to run the command (checkpoint is the AMR3.parsing-1.0.tar.bz2 one) ``` python bin/train.py --config configs/config.yaml --direction amr --checkpoint /content/drive/MyDrive/AMRS/SPRING_AMR3_parser.pt ``` I get the error ``` Traceback (most recent call...

MonoT5 Reranker assigning same score to every document

For some reason when using the monoT5 reranker class to rerank results from a LuceneSearcher it assigns the same score to every document. I was able to fix this problem...

merge_lora_weights_and_save_hf_model.py Error while deserializing header: HeaderTooLarge

Trying to run the following: ``` python /projects/geba2844/LongLora/LongLoRA/merge_lora_weights_and_save_hf_model.py \ --base_model /projects/geba2844/LongLora/Llama-2-7b-hf \ --peft_model /projects/geba2844/LongLora/Llama-2-7b-longlora-8k \ --context_size 8192 \ --save_path /projects/geba2844/LongLora/Llama-2-7b-longlora-8k-hf ``` Returns the following error: ``` bash-4.4$ bash merge.sh base...