djl-serving

djl-serving copied to clipboard

## Description ## Update the tokenizer for benchmarks

lanking520

## Description ## Remove engine from the settings

lanking520

## Description ## Prepare dataset per guidance

lanking520

## Description ## Per-token text is not supported. This may needs some changes on vllm/lmi_dist side. Per-token cum_logprob is not supported, but should be easy to add.

ymwangg