trapper
trapper copied to clipboard
obss
State-of-the-art NLP through transformer models in a modular design and consistent APIs.
When trying to run the POS Tagging Example experiment, I get the following exception: ``` Traceback (most recent call last): File "/home/sophylax/anaconda3/envs/trapper/lib/python3.7/site-packages/allennlp/common/params.py", line 211, in pop value = self.params.pop(key) KeyError:...
Adding support for callbacks, [transformers' callbacks](https://huggingface.co/docs/transformers/main_classes/callback) supports many 3rd party tools as well.
Right now we are fixed on a certain version for these two packages. But we might be able to support a range of versions, increasing compatibility with other projects.
Support single plugin file e.g. in `~/.trapper_plugins` containing the modules that can be used in multiple projects. allennlp already supports that, so it should be easy to add.
Instead of doing the tensor conversion manually, we can do something like dataset.set_format(type='torch', columns=['input_ids', 'token_type_ids', 'attention_mask', 'label']) as shown in [datasets doc](https://huggingface.co/docs/datasets/use_dataset.html#format). This would also enable removing the unused columns...