super-json-mode icon indicating copy to clipboard operation
super-json-mode copied to clipboard

Published 20 hours ago • verified publisher icon varunshenoy
→

Metadata

Low latency JSON generation using LLMs ⚡️

Results 1 super-json-mode issues
Sort by recently updated
recently updated
newest added

SGLang Integration

1 comment

Nice project! I believe this project can greatly benefit from https://github.com/sgl-project/sglang. You can try to use SGLang as a backend for local models. - The fast JSON decoding [feature](https://lmsys.org/blog/2024-02-05-compressed-fsm/) can...

merrymercy avatar merrymercy

← Metadata

347
Stars
11
Forks
Watchers

Owner

verified publisher icon varunshenoy

Metadata

Low latency JSON generation using LLMs ⚡️

Back