lmql icon indicating copy to clipboard operation
lmql copied to clipboard

OpenAI Chat 'choices' ("where")

Open jloganolson opened this issue 1 year ago • 0 comments

Sorry if this is covered in a different thread are there any plans to support choices with openai chat akin to Outlines (https://github.com/outlines-dev/outlines/blob/main/outlines/models/openai.py#L191) - at least with pip install lmql this currently doesn't work:

sample(temperature=0.8)
   "A list of things not to forget when going to the sea (not travelling): \n"
   "- Sunglasses \n"
   for i in range(4):
      "- [THING] \n"
from
   'openai/gpt-3.5-turbo'
where
   THING in set(["Volleyball", "Sunscreen", "Bathing Suite"])

jloganolson avatar Dec 19 '23 19:12 jloganolson