Jan Wassenberg

Good, so it's getting the argument value correctly. You can run [STREAM](https://www.cs.virginia.edu/stream/) to benchmark bandwidth, it also supports threading. +1 to the SFP suggestion.

Hi, it would have to be added to the linker flags, for example adding to the line `target_link_libraries(gemma hwy hwy_contrib sentencepiece)` in CMakeLists.txt, then rm -rf the build directory.

Glad to hear compiling works. Huh, I have not yet seen setaffinity fail, but it is possible. Do you have any cpushield or offline CPUs? What kind of platform/CPU is...

Thanks for sharing. That makes sense, changing to an fprintf warning.

Hi @justinsb, after a huge delay, we are catching up on issues and suggestions this week :) One update is that batching is now supported, but hasn't seen a lot...

Hi, it looks like your compiler would require an update, it is too old. I'm curious which version it is?

Thanks, the compiler is recent enough. It seems that binutils (gas) is too old. Version 2.3 from 2018 would be required.

It's the same model but this repo cannot use those weight formats directly. We have an internal export script that transforms other formats into our simple blob format, but this...

Hi, we are just using `std::getline` for input. Does anyone have experience with handling array keys on OSX?

I've looked into this a bit more and there is a workaround, installing rlwrap: https://stackoverflow.com/questions/21384040/why-does-the-terminal-show-a-b-c-d-when-pressing-the-arrow-k/76418140#76418140 It seems that's about all we can do when using standard C or C++ libraries...