vllm icon indicating copy to clipboard operation
vllm copied to clipboard
verified publisher icon vllm-project

Add support for GPTJ

Open ri938 opened this issue 2 years ago • 3 comments

Will it be possible to add support for GPTJ please? Any plans for this?

ri938 avatar Jun 21 '23 19:06 ri938

Supporting GPTJ is in our plan! Please stay tuned and let us know if you are interested in contributing!

zhuohan123 avatar Jun 22 '23 15:06 zhuohan123

GPT-J and GPT-NeoX have similar architectures. Maybe a hacky solution is possible as of now.

beratcmn avatar Jun 22 '23 22:06 beratcmn

For what it's worth I'd also be very interested in this feature

Vineetls avatar Jun 23 '23 18:06 Vineetls

Fixed by #226

zhuohan123 avatar Jul 12 '23 15:07 zhuohan123