punica
punica copied to clipboard
Support for GPT-NEOX models
Hello! Thank you for this awesome work. I am testing Punica
for serving my custom models and it has GPT-NEOX model as the base model. Currently, does Punica
support other models than Llama?
If it doesn't require much modification, I would like to request to give us some manual to add new models.
Thank you! :)