a-palacios

Results 1 comments of a-palacios

Allow payload request to support extra inference method kwargs

Hi @adriangonz, we are still running into an issue with this. The python code works fine for passing in new tokens via kwarg or in a config like you listed...