tabgenie icon indicating copy to clipboard operation
tabgenie copied to clipboard

Load own HF model

Open kasnerz opened this issue 3 years ago • 1 comments

The user will be able to interactively generate output with their own model.

If the model is loaded alongside the app (which is the default idea), it should be fairly easy – the user will just specify the path to the checkpoint + the model name and AutoModel and AutoTokenizer will do the rest.

Other options to consider: communicate via REST API, use some existing APIs.

kasnerz avatar Nov 18 '22 09:11 kasnerz

There are currenly two ways of using the model: locally or via API, both through pipelines.

It could still be a good idea to allow the user to connect their own model in the web interface, but it is not completely necessary atm.

kasnerz avatar Dec 22 '22 16:12 kasnerz