litgpt icon indicating copy to clipboard operation
litgpt copied to clipboard

Deployment example

Open awaelchli opened this issue 1 year ago • 1 comments

It's not clear to users how they would take a trained LitGPT model and deploy it. There are of course 100 ways to do that but maybe we could have one standard example.

We have a conversion tutorial here https://github.com/Lightning-AI/litgpt/blob/main/tutorials/convert_lit_models.md#a-finetuning-and-conversion-tutorial but it stops there. We also have several Studios but it's not clear which one to use as a template.

awaelchli avatar Apr 05 '24 16:04 awaelchli

I'll try to expand on that, maybe it could be based on LitServe

rasbt avatar Apr 05 '24 17:04 rasbt

This was addressed in #1299

rasbt avatar Apr 18 '24 19:04 rasbt