Maximiliano Levi

Results 43 issues of Maximiliano Levi

Hi, Is it currently possible to write a custom sampler to use with the executor API? I want to sample tokens in way that is not supported by the current...

triaged
waiting for feedback

Hi, I get the following error when: * Lookahead decoding is enabled * Request has multimodal input (e.g. just custom prompt table with fake vocabulary) * batch size > 1...

question
triaged