aider icon indicating copy to clipboard operation
aider copied to clipboard
Published 3 months ago • verified publisher icon Aider-AI

chore: Replace non-breaking hyphen with regular hyphen in prompt

Open ei-grad opened this issue 10 months ago • 1 comments

Some tokenizers may incorrectly handle the non-breaking hyphen (U+2011), potentially leading to unexpected behavior or token counts. Replacing it with the standard hyphen-minus (U+002D) ensures broader compatibility and avoids potential tokenization issues.

ei-grad avatar Apr 20 '25 19:04 ei-grad

Gemini 2.5 Flash example: image

ei-grad avatar Apr 20 '25 21:04 ei-grad