Llama-Chinese icon indicating copy to clipboard operation
Llama-Chinese copied to clipboard

Published 20 hours ago • verified publisher icon LlamaFamily

使用vllm优化llama

Open Lvjinhong opened this issue 1 year ago • 1 comments

我想基于vllm针对llama做一些特定优化，大佬们可以给些方向吗

Lvjinhong avatar Dec 19 '23 02:12 Lvjinhong

vllm本身对llama 已经优化了很多了，更细节的就比较有难度了

ZHangZHengEric avatar Jan 15 '24 07:01 ZHangZHengEric