Gary Mulder

Run `top` and watch the `./quantize` memory utilisation. Also keep an eye on your disk space.

Thanks for the reply. Should I leave this issue open to track your updates?

You might not be comparing apples to apples. e.g. are the `--top_p` and other parameters identical between implementations?

`top_k` looks to be currently broken, as I recently reported in issue #56. I just now realised that due to #95 identical seeds across implementations are unlikely to produce identical...

> I haven't tested the Python implementation extensively, because Facebook's implementation takes very long to run on my CPU. But I generally feel that running 7B and even 13B with...

Flags indicate your Virtualbox instance supports `avx`. Can you try `g++10`? `g++10` works for me under Ubuntu 22.04 and I just compiled it successfully in Docker using Debian 10 and...

> g++ (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0 You're using `g++9.4.0`. [This might help](https://ahelpme.com/linux/ubuntu/install-and-make-gnu-gcc-10-default-in-ubuntu-20-04-focal/)

Now that `g++` is `g++10`, try just typing: `make clean;make`

It works under Docker with `g++10`, so it points to an issue with Virtualbox. Why do you need to use Virtualbox?

Nope, I just smoke tested the compile in a running instance. However someone just now published a pull request for Docker support here #132 :rocket: