outlines icon indicating copy to clipboard operation
outlines copied to clipboard
Published 2 months ago • verified publisher icon dottxt-ai

Using the HuggingFace API

Open erlebach opened this issue 1 year ago • 1 comments

Is it possible to create a program that uses a model on HuggingFace together with Outlines via the HuggingFace API (i.e., avoiding download of the model). So far, it appears that the answer is that it is not possible. If it is not possible, could you please explain the difficulty? Is it the impossibility of accessing the output logits of a model running using the API? Thanks.

erlebach avatar Nov 22 '24 23:11 erlebach

We would need to integrate the method directly on Hugging Face's servers.

rlouf avatar Nov 28 '24 20:11 rlouf