super-json-mode
super-json-mode copied to clipboard
Published
20 hours ago •
varunshenoy
varunshenoy
Low latency JSON generation using LLMs ⚡️
Results
1
super-json-mode issues
Sort by
recently updated
recently updated
newest added
Nice project! I believe this project can greatly benefit from https://github.com/sgl-project/sglang. You can try to use SGLang as a backend for local models. - The fast JSON decoding [feature](https://lmsys.org/blog/2024-02-05-compressed-fsm/) can...
