m0nsky

### Background & Description I was working on a C# class -> GBNF converter, and came across this: https://github.com/ggerganov/llama.cpp/blob/master/grammars/README.md#json-schemas--gbnf Here's an example, thanks to [this reddit post](https://www.reddit.com/r/LocalLLaMA/comments/1dj6cpb/comment/l98yute/). Example JSON: ```json...

### Description I'm building a llava application. When the amount of tokens in my initial prompt is bigger than the batch size, the `InteractiveExecutor` will throw a: ``` System.ArgumentException: Offset...