Dirk Groeneveld issues

Results 84 issues of


                                            Dirk Groeneveld

Crashes on Mac

I built this on Mac, and even though it starts up, it crashes after dragging around things for a little bit. It's also pretty ugly, because the default style of...

Use pytorch transformer

This uses the new pytorch transformer from the core library.

Fix BERT SRL

Rename `Task` -> `Dataset` and `Model` -> `ModelWrapper`

Adding models/methods/datasets

Motivation: Various people have asked for various additions to Catwalk already. It's risky because nobody is using Catwalk yet. But we have several people who said they want to (Pradeep,...

Min et al. variant of in-context learning

Motivation: It's a good baseline that should be easy to implement in the catwalk context, but nobody has asked for it. Described by Liu at al like this: Min et...

Add a way to train a model before evaluating it

Motivation: Full fine-tuning is a baseline, or rather an upper bound, in many zero-shot and few-shot experiments. @pdasigi has explicitly asked for this. As part of this work, we'll add...

Add more models

perplexity needs to pass down the number of tokens, so we can match official numbers

... official numbers from EAI, that is

Import all the CrossFit tasks

CrossFit has a somewhat unified format for their tasks. We could use it to get a bunch of tasks with very little code. Here is a list of patterns that...