Evan Jones
Evan Jones
@ain @brikis98 what's the verdict here re: VirtualBox as a dependency? The project README only lists Homebrew as a prerequisite. We should either add VirtualBox/Docker Toolbox there or add VirtualBox...
@AlienKevin thanks for investigating! Yeah it's a simple top-down backtracking parser so it can be exponential in the worst case. It works best for grammars with little or no ambiguity...
Seems reasonable to me.
Love this work @ochafik! I plan to take a look soon, need to wrap my head around the parser changes and the new JSON schema converter (now in C++?).
#1397 looks like it could address this
For generating arbitrary JSON, there's a JSON grammar provided in `grammars/json.gbnf`: ``` % ./main -m $L13B -p 'The weather for today: ' --grammar-file grammars/json.gbnf ... The weather for today: {"temp":450,...
I believe #1169 covers this
@mikeggh I put up an implementation of saving/restoring initial prompt state in #1169
@mishudark originally I think it was 20GB per the table in the README, but now with mmap I think it's much lower. Activity Monitor report only a few GB for...
@dmahurin in terms of program logic it probably wouldn't take much; starting from the end of the session is actually simpler because you're not finding a common prefix. I think...