djl-serving icon indicating copy to clipboard operation
djl-serving copied to clipboard

Published 20 hours ago • verified publisher icon deepjavalibrary

[doc] update beam search parameters in io schema

Open sindhuvahinis opened this issue 6 months ago • 0 comments

Description

Updated best_of_sequences in the output schema and also best_of, n, num_beams in generation parameters of vllm and lmi-dist.

sindhuvahinis avatar Aug 02 '24 01:08 sindhuvahinis