vllm icon indicating copy to clipboard operation
vllm copied to clipboard

Published 20 hours ago • verified publisher icon vllm-project

Support for chatglm-6b

Open datalee opened this issue 1 year ago • 2 comments

It would be great if you could support chatglm-6b，It's a popular chinese model。 https://huggingface.co/THUDM/chatglm-6b

datalee avatar Jun 25 '23 03:06 datalee

mark

zhaoying9105 avatar Jul 02 '23 13:07 zhaoying9105

mark

HJT9328 avatar Jul 02 '23 15:07 HJT9328

mark

binarrii avatar Jul 15 '23 11:07 binarrii

If anyone is familiar with chatGLM model architecture, feel free to help on #625. I am new to transformer architecture and not sure if my changes is correct..

Jeffwan avatar Jul 31 '23 18:07 Jeffwan

If anyone is familiar with chatGLM model architecture, feel free to help on #625. I am new to transformer architecture and not sure if my changes is correct..

Vllm can support chatglm 6b now？

cabbagetalk avatar Aug 21 '23 09:08 cabbagetalk

If anyone have bandwidth to help us implement ChatGLM3 support, please leave a comment and coordinate here: https://github.com/vllm-project/vllm/issues/1552

simon-mo avatar Nov 02 '23 18:11 simon-mo

ChatGLM supported in #1261

hmellor avatar Mar 06 '24 16:03 hmellor