Leo Gao

Python supports objects in map key, but js doesn't. The js map will end up having the string "[object Object]" as key instead. If implementing this has negative performance implications,...

As I understand it, the layout (ordering of the columns, etc) is saved in local storage. However, on a larger team it may be helpful to be able to set...

Right now, if I resume an experiment from checkpoint, or if I do transfer learning, the metrics get split across multiple different runs, which makes the metric graphs more difficult...

Integration with lm-eval-harness

1

I think it would be great to have AI21 api integration in the EleutherAI lm-eval-harness (https://github.com/EleutherAI/lm-evaluation-harness), which would allow evaluating the AI21 api on far more tasks.

Is it possible to split it such that layers are split along some dimension of the mesh too? For example: Mesh shape: `x:16,y:32` Layout: `layers: x, hidden: y` If I...