lmql icon indicating copy to clipboard operation
lmql copied to clipboard

Allow distribution in the middle of a prompt

Open fjfricke opened this issue 1 year ago • 2 comments

Since guidance is supporting it, could we add support for distributions not only at the end but also in the middle of the program?

fjfricke avatar Aug 02 '23 11:08 fjfricke

Are you looking just for a VAR in [a,b,c,..] constraint or are you interested in normalised probabilities across all possible values?

lbeurerkellner avatar Aug 02 '23 12:08 lbeurerkellner

I am looking for normalized probabilities across the possible values. In guidance, this can be done by specifying the logprob parameter in a select statement (see guidance - select).

fjfricke avatar Aug 02 '23 15:08 fjfricke