Evan Jones

Results 46 comments of Evan Jones

@ain @brikis98 what's the verdict here re: VirtualBox as a dependency? The project README only lists Homebrew as a prerequisite. We should either add VirtualBox/Docker Toolbox there or add VirtualBox...

@AlienKevin thanks for investigating! Yeah it's a simple top-down backtracking parser so it can be exponential in the worst case. It works best for grammars with little or no ambiguity...

Seems reasonable to me.

Love this work @ochafik! I plan to take a look soon, need to wrap my head around the parser changes and the new JSON schema converter (now in C++?).

#1397 looks like it could address this

For generating arbitrary JSON, there's a JSON grammar provided in `grammars/json.gbnf`: ``` % ./main -m $L13B -p 'The weather for today: ' --grammar-file grammars/json.gbnf ... The weather for today: {"temp":450,...

@mikeggh I put up an implementation of saving/restoring initial prompt state in #1169

@mishudark originally I think it was 20GB per the table in the README, but now with mmap I think it's much lower. Activity Monitor report only a few GB for...

@dmahurin in terms of program logic it probably wouldn't take much; starting from the end of the session is actually simpler because you're not finding a common prefix. I think...