text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard

[DOC] Write documentation around setting the input_lenght, batch size and decode length parameters

Open OlivierDehaene opened this issue 2 years ago • 2 comments

See: #165

OlivierDehaene avatar Apr 13 '23 12:04 OlivierDehaene

Hey, I am new to this repository, and fascinated by the way the inference is done. I would like to start with this issue, but I first need to get familiar with the repository/pipeline. How can I get started?.

Aryan-Deshpande avatar Apr 27 '23 12:04 Aryan-Deshpande