Matvey Soloviev

Thanks for the review! I do wish we could find a more elegant solution, but it's not easy. > In that sense maybe using a "global state" for the console...

> Response > > `人生の意は、一人が一人ということであります。は安部が立していたので、去からは一人の人にれるのはにとどまったのですが、そう` The Japanese text you quote here is fairly agrammatical, in a way that suggests (on top of some other issues that I figure are simply...

I'm working on adding a sort of interactive mode [over in a fork](https://github.com/blackhole89/llama.cpp), where (if a flag, `-i`, is passed) you can either interrupt generation with SIGINT or specify a...

I unfortunately don't have access to a Windows machine to test it on right now. Is there a problem with the availability of signal.h/sigaction there? Either way, at least the...

I added a section (and made the PR). Not sure in hindsight if it's the best possible example, since it doesn't show how the usage of \ to submit multiple...

I realised that the slight imprecision in calling London the largest city in (all of) Europe actually biased the entire generation in a less factual direction, so here's another screenshot...

Great, thanks! I also figured out what was going wrong with the color getting cancelled early; I can make a quick PR for that shortly, though it might be necessary...

Ah, nice. If all the work it does there can be cached, this might make the LLaMa quite usable even without finetuning. I'll do some more experiments to see how...

How would this interact with recursive calls? I can see it not being a problem at top level due to order-independence (so a recursive `const f = fn() ... {...

c0000005 is the Windows version of a segmentation fault, if I recall correctly. I haven't tested with >13B myself, but it's quite surprising if something broke for that case only....