mcQA icon indicating copy to clipboard operation
mcQA copied to clipboard

🔮 Answering multiple choice questions with Language Models.

Results 16 mcQA issues
Sort by recently updated
recently updated
newest added

I am trying to run the example, getting this error : `ImportError: cannot import name 'MCQAData' from 'mcqa.data'` There is no MCQAData function.

bug
documentation
help wanted

https://github.com/iterative/cml

Ideas: * Check scikit-learn speed guide: https://scikit-learn.org/stable/developers/performance.html * Check pybind: https://github.com/pybind/pybind11

Consider huggingface Trainer and/or PyTorch lightning. Add ONNX support.

enhancement
dev

enhancement
help wanted
dev

Change the doc strings to Google style.

documentation
help wanted
good first issue

check the tutorial [here](https://realpython.com/python-type-checking/). The idea is to add type hints in all methods and functions, avoiding duck typing.

enhancement
help wanted
good first issue
dev

LMs to add : * [openai gpt](https://github.com/huggingface/pytorch-transformers/blob/master/pytorch_transformers/modeling_openai.py) * [gpt2](https://github.com/huggingface/pytorch-transformers/blob/master/pytorch_transformers/modeling_gpt2.py) Also, try to use `pytorch hub` instead. * [GPT-2](https://pytorch.org/hub/huggingface_pytorch-pretrained-bert_gpt2/) * [GPT](https://pytorch.org/hub/huggingface_pytorch-pretrained-bert_gpt/) * [BERT](https://pytorch.org/hub/huggingface_pytorch-pretrained-bert_bert/)

enhancement
dev
urgent

The idea is to create example notebooks for use cases using the library. You can start by benchmark training on Swag or CoS-E datasets.

documentation
help wanted
good first issue
dev
urgent

The idea is to write a hyper-parameters selection wrapper like `sklearn`'s `GridSearch` and `RandomizedGridSearch` that can ensure training the `mcQA` model with various parameters and selecting one of the combinations...

enhancement
good first issue
dev
urgent