syncode icon indicating copy to clipboard operation
syncode copied to clipboard

Efficient and general syntactical decoding for Large Language Models

Results 23 syncode issues
Sort by recently updated
recently updated
newest added

Hi, cool project! However, the example for Python code generation from your [README](https://github.com/structuredllm/syncode?tab=readme-ov-file#-generate-indentation-error-free-python-code) appears to be broken. **1) Model** `WizardLM/WizardCoder-1B-V1.0` seems to be no longer available on Hugging Face, so...

Hi! Can the huggingface's 'reptition penalty' parameter be utlized with SynCode? My output with grammar_mask is often stuck in generating high probability loops.

version: v0.4.12 According to the JSON specification (RFC 8259), trailing dot is prohibited for floating point. However, when I define the new JSON grammar like below, I found the lexer's...

Hi :) Can someone please tell me the difference between the grammar_mask and grammar_strict mode? What are the difference in calculation of tokens etc. I am using constrained decoding for...

It would be very usefull to have the option to use flash attention to increase speed and lower memory usage.

When testing the JSON grammer with Gemma3-12B-IT, the model produces a json which ends like this "] \xa0}". The entire json structure is ```json { "key": [ {"inner_key":"value"}, {"inner_key":"value"} ]...

I am experiencing issues with the built-in grammars for Java, Python, and Go. The Python and Java grammars appear to be ignored, while the Go grammar produces mostly gibberish. Below...

Like this parser = Lark(ocaml_grammar, start='start', parser='lr') but i check that only support LR and LALR?

Bumps [regex](https://github.com/mrabarnett/mrab-regex) from 2024.11.6 to 2025.11.3. Changelog Sourced from regex's changelog. Version: 2025.11.3 Git issue 594: Support relative PARNO in recursive subpatterns Version: 2025.10.23 'setup.py' was missing from the source...

dependencies
python

Bumps [transformers](https://github.com/huggingface/transformers) from 4.53.2 to 4.57.1. Release notes Sourced from transformers's releases. Patch release v4.57.1 This patch most notably fixes an issue with an optional dependency (optax), which resulted in...

dependencies
python