gpt-j-api icon indicating copy to clipboard operation
gpt-j-api copied to clipboard

New endpoints to the API

Open vicgalle opened this issue 3 years ago • 3 comments

For example, we could make it easy to serve some specific tasks, such as

  • [x] #11
  • [ ] #23
  • [ ] #40
  • [ ] Dialog between two persons, plus some kind of memory buffer

vicgalle avatar Jul 20 '21 10:07 vicgalle

@vicgalle

Hi there,

I'm noticing that the version of the serve.py file on the main branch doesn't seem to actually be creating the zero-shot classification endpoint that should have been added in the v0.3 release. Am I missing something obvious?

I'm super excited to try out that feature!

Thanks, Daniel

danielweidman avatar Aug 16 '21 13:08 danielweidman

@vicgalle

Hi there,

I'm noticing that the version of the serve.py file on the main branch doesn't seem to actually be creating the zero-shot classification endpoint that should have been added in the v0.3 release. Am I missing something obvious?

I'm super excited to try out that feature!

Thanks, Daniel

Hi @danielweidman , thank you for your interest in the new version!

I have not made public the changes in the implementation yet since i'm planning on a refactor of the server code (while keeping the public API intact) after I return from vacation.

However, if you are interested in setting up a zero-shot classification model, the one that is currently serving the API is this one: https://huggingface.co/vicgalle/xlm-roberta-large-xnli-anli (there are instructions there).

Let me know if you have further questions!

vicgalle avatar Aug 21 '21 13:08 vicgalle

I see! Thanks very much for the info and that link! I hope your vacation is going well.

danielweidman avatar Aug 24 '21 04:08 danielweidman