Jason Phang

Tweaks for lm-eval-harness

2

- Importing one fix from Microsoft/DeepSpeed - Disable `sanity_check`, which does not seem to be doing the right thing. (For some reason it checks against every possible mergeable weight key,...

PEGASUS-X

1

# What does this PR do? Adds [PEGASUS-X](https://arxiv.org/abs/2208.04347) implementation. ## Before submitting - [ ] This PR fixes a typo or improves the docs (you can dismiss the other checks...

(Documented as TODO in code.)

Python 3.6.9 (Colab) doesn't handle circular imports properly

1

We primarily develop against Python 3.7, but Colab uses 3.6.9, which handles circular imports a little differently. This currently causes problem with our `jiant.tasks` imports. We run into the following...

**WIP** Recommended update steps: * Merge from `origin/master`. * Rerun `export_models.py` for relevant models because the model weights and configs are now saved in slightly different paths.

Guide for adding a model

2

ELECTRA would be a good first example for anyone interested.

Currently, SQuAD-style tasks have a special preprocessing pipeline as one example maps to multiple `data_rows`. As such, there are some unused methods in the Task definition. Let's improve the exceptions...