jetstream-pytorch icon indicating copy to clipboard operation
jetstream-pytorch copied to clipboard

Support passing custom sampling function.

Open wang2yn84 opened this issue 11 months ago • 0 comments

Users can pass in custom sampling function now. But it's not per request sampling because it's hard to track all the sampling functions in the jitted function. It applies to all the batches. The changes on the JetStream side is pending, not in yet.

wang2yn84 avatar Dec 01 '24 16:12 wang2yn84