LastWhisper

[Usage]: How to use vLLM with `Tensor` input (customized tokenizer).

2

### Your current environment ```text Collecting environment information... PyTorch version: 2.1.2+cu121 Is debug build: False CUDA used to build PyTorch: 12.1 ROCM used to build PyTorch: N/A OS: Ubuntu 22.04.3...

✨ First of all, the Llama project is a tremendous asset to the entire GenAI field. I deeply appreciate the contributions of both the Llama team and the open-source community....

[Bug] Fail to deploy serving model on the Azure Machine Learning Platform. Exited with failure (confusing error information and exit code)

2

**Description** I really appreciate the PyTriton framework for its ease of use. I've successfully deployed it in a local environment. Subsequently, I attempted to deploy a model on the Azure...