Sindhu Somasundaram

## Description This is not actually an error on DJLServing. Just tracking this here. Will raise an issue in HF as well. HF Pipeline actually trying to generate the outputs...

*Issue #, if available:* *Description of changes:* By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

## Description ## ### Testing Tested in my EC2 local machine. Built a container and ran the CI by pushing the image in my private dockerhub account. https://github.com/deepjavalibrary/djl-serving/actions/runs/9019241325/job/24781785296 In the...

[Bug]: Error while running inference with LLava 1.6 in v0.5.1

9

### Your current environment ```text Collecting environment information... PyTorch version: 2.3.0+cu121 Is debug build: False CUDA used to build PyTorch: 12.1 ROCM used to build PyTorch: N/A OS: Ubuntu 22.04.4...

## Description ## Brief description of what this PR is about - If this change is a backward incompatible change, why must this change be made? - Interesting edge cases...

## Description ## Updated best_of_sequences in the output schema and also best_of, n, num_beams in generation parameters of vllm and lmi-dist.