Kerfuffle

Would it be too confusing to call it `--toggle-increased-determinism` or something like that? This way, it could get automatically enabled with `--seed` but disabled if necessary or enabled otherwise as...

How about this approach? It adds a `--increased-determinism` option that can be set to `auto` (default), `on`, `off`. The option includes an explanation of why it's necessary. I made `Model::evaluate`...

I did some profiling and the difference between the charts seems very small, so the observed differences probably aren't anything more than noise. (It looks like copying the data may...

I should add that this is the first time I've tried profiling Rust code or reading flamegraphs so my opinion about it isn't too authoritative. It doesn't seem like there's...

@setzer22 How about this? I left it as a parameter in the library (defaulting to enabled) but removed the CLI stuff. The rationale is it doesn't really add much complexity...

@philpax Were you talking about the CLI option, or just making it 100% not configurable at all? I can do that if you _really_ want, but personally I'd give it...

He hasn't seen the light yet, that poor lost soul. The real answer is probably because C++ is what he knows/is experienced with and also had already written stuff like...

I've been messing around with adding compression to this. Weirdly, the natural approach of just wrapping the reader/write in compression functions is unbearably slow. (Including loading/decompressing.) However, compressing to a...

@philpax Pullception: https://github.com/philpax/llama-rs/pull/1 Commenting here in case you want to keep discussion in one place.

If it's helpful information, I've been doing a bit of experimenting and came up with some information about the session state: My first idea was that possibly a lot of...