DeBERTa
DeBERTa copied to clipboard
microsoft
The implementation of DeBERTa
### Description I use a script similar to `cola.sh` to train and/or evaluate a model for sequence classification. There are two possible parameters for model state files `init_model` and `pre_trained`....
The way the symmetric KL Loss is implemented here (for sift loss) https://github.com/microsoft/DeBERTa/blob/4d7fe0bd4fb3c7d4f4005a7cafabde9800372098/DeBERTa/sift/sift.py#L180 differs from the symmetrized Kullback Leiber divergence, in particular it is not zero when both inputs are...
Traceback (most recent call last): File "C:\Users\bartw\PycharmProjects\DeBERTa\DeBERTa\apps\run.py", line 476, in main(args) File "C:\Users\bartw\PycharmProjects\DeBERTa\DeBERTa\apps\run.py", line 317, in main train_model(args, model, device, train_data, eval_data, run_eval_fn, loss_fn=loss_fn, train_fn = train_fn) File "C:\Users\bartw\PycharmProjects\DeBERTa\DeBERTa\apps\run.py", line...
requirements.txt file contains 'sklearn' which should be corrected to package name 'scikit-learn' in order to avoid pip installation failure
Hi, model_name = 'microsoft/deberta-v3-large' tokenizer = AutoTokenizer.from_pretrained(model_name) model = AutoModel.from_pretrained(model_name) When I load the v3 model, it return a V2 model instead, how can I use the v3 model and...
In the README file, corrected an error in the usage instructions for conducting forward passes with DeBERTa. The previous instructions contained inaccuracies that could lead to misinterpretation and improper utilization...
The 'sklearn' PyPI package is deprecated, use 'scikit-learn' rather than 'sklearn' for pip commands. Here is how to fix this error in the main use cases: - use 'pip install...
Hello. When I try load model deberta I get the following error: AssertionError: [] `/opt/tljh/user/lib/python3.9/site-packages/DeBERTa/deberta/deberta.py:143 in key_match def key_match(key, s): c = [k for k in s if key in...
Issue Description: I am encountering difficulties with the multiprocessing package. When attempting to run my code using the `assync_dataloader` on a single GPU in MS Windows 10, I encountered the...
