punica icon indicating copy to clipboard operation
punica copied to clipboard

Support for GPT-NEOX models

Open bibekyess opened this issue 1 year ago • 0 comments

Hello! Thank you for this awesome work. I am testing Punica for serving my custom models and it has GPT-NEOX model as the base model. Currently, does Punica support other models than Llama? If it doesn't require much modification, I would like to request to give us some manual to add new models. Thank you! :)

bibekyess avatar Nov 21 '23 02:11 bibekyess