Add ensure_ascii parameter to json function
Add ensure_ascii parameter to json function in generate
Thank you for contributing! What was the issue prior to this PR?
Thank you for contributing! What was the issue prior to this PR?
Hi, different models have different tokenizers and samples for learners, so for languages whose characters are not in ascii, this parameter is required, it's just that the models were not always trained on \uXXXX
Sorry for not responding right away, there was no notification.
Hi @lm-cyber! The library has changed a lot recently since we released Outlines v1. I believe it makes handling the subject of your PR either though! I think what we could do is to add an optional parameter for ensure_ascii to the __init__ of the JsonSchema object in the outlines/types/dsl.py file.
Closing it as the issue has been treated by #1672