syncode icon indicating copy to clipboard operation
syncode copied to clipboard
verified publisher icon uiuc-focal-lab

Can reptition penalty be utilized in SynCode?

Open Sindre01 opened this issue 7 months ago • 1 comments

Hi!

Can the huggingface's 'reptition penalty' parameter be utlized with SynCode?

My output with grammar_mask is often stuck in generating high probability loops.

Sindre01 avatar Apr 30 '25 09:04 Sindre01

Hi @Sindre01,

I would recommend using SynCode as custom logits processor (example to be able to use all features provided by HF generation.

shubhamugare avatar May 01 '25 13:05 shubhamugare