Custom sampler for executor API

Open maxilevi opened this issue 10 months ago • 1 comments

Hi,

Is it currently possible to write a custom sampler to use with the executor API? I want to sample tokens in way that is not supported by the current API and exiting the generation loop at each step to do so slows things down too much

Mar 10 '25 14:03 maxilevi

@maxilevi , do you mind to share more details (prefer sample code for illustration) on why it is not supported by current executor API and what is your request in details? thanks!

Mar 17 '25 02:03 dominicshanshan

Issue has not received an update in over 14 days. Adding stale label.

Mar 31 '25 03:03 github-actions[bot]

This issue was closed because it has been 14 days without activity since it has been marked as stale.

Apr 14 '25 03:04 github-actions[bot]