litellm icon indicating copy to clipboard operation
litellm copied to clipboard

Published 20 hours ago • verified publisher icon BerriAI

feat: read chat-template from tokenizer files for vllm

Open nidhishs opened this issue 7 months ago • 3 comments

Title

Support reading the chat-template embedded in the tokenizer files for vllm. We can use the transformers library directly since transformers is a dependency for vLLM, and if the custom_llm_provider is vLLM, the user must have it installed.

Relevant issues

Fixes #1251

Type

🆕 New Feature

nidhishs avatar Jul 16 '24 19:07 nidhishs