candle icon indicating copy to clipboard operation
candle copied to clipboard

Does candle provide pytorch's torch.multinomial?

Open monadbobo opened this issue 1 year ago • 2 comments

https://pytorch.org/docs/stable/generated/torch.multinomial.html. If it is not implemented, I can implement this interface

monadbobo avatar Jul 07 '24 03:07 monadbobo

+1

zachcp avatar Nov 27 '24 16:11 zachcp

https://docs.rs/candle-transformers/latest/candle_transformers/generation/struct.LogitsProcessor.html#method.sample provides it, I believe.

alex avatar Apr 18 '25 19:04 alex