OpenDelta issues

Results 29 OpenDelta issues

Sort by recently updated

How to change the size of the dataset?

Hi @ShengdingHu , thanks for sharing the code. May I ask that how to change the size of dataset. It seems that that the COPA have 400 train dataset, 50...

CaffreyR

compatibility with pytorch

Hi. here is another problem. See, I use opendelta and pytorch lightning to fine tune my model using lora. But when I tried to load, it seems wrong since it...

CaffreyR

RuntimeError: This is a delta model, which should be attached to a backbone model and can't forward any data by itself. Please using the backbone model's forward function after attach the delta model to the backbone. eceived was empty, your model won't be able to train on it. Double-check that your training dataset contains keys expected by the model: args,kwargs,label_ids,label.

I used bert model to train on RAFT datasets, the original model went well. But when I tried to add LowRankAdapterModel to finetune, it went wrong. I just simply apply...

CaffreyR

LowRankAdapter not working with Bert models

Ok I am trying to use LowRankAdapterModel with bert-base-uncased and bert-large-uncased and I am getting the following error. Please look into it --------------------------------------------------------------------------- KeyError Traceback (most recent call last) [](https://localhost:8080/#)...

MrigankRaman