John Hewitt

Right now, to test a new representation learner, one must: 1. Use the representation learner to write hidden state vectors for each token (or subword) to disk. (Better idea for...

TypeError in escape_md

1

## Version : 2016.9.19 ## Python Version : 2.7.13 A large number of non-English web pages I'm working with break html2text. Attached is an HTML file that replicates this issue....

This codebase could be a nice successor to the [structural probes codebase](https://github.com/john-hewitt/structural-probes) except, well, it doesn't actually implement the specific structural probe data processors, probes, and reporters. For example, the...

Is there explicitly instruction-following data in the version of Dolma used to train Olmo v1?

3

Hi everyone, I'm working on a research project relating to instruction following, and it would be amazing to have a language model with a guarantee that no _explicitly_ instruction-following data...

Is there explicitly instruction-following data in the version of Dolma used to train v1?

1

Hi everyone, I'm working on a research project relating to instruction following, and it would be amazing to have a language model with a guarantee that no _explicitly_ instruction-following data...