chat.petals.dev icon indicating copy to clipboard operation
chat.petals.dev copied to clipboard

Published 20 hours ago • verified publisher icon petals-infra

Integration in Oobabooga webui?

Open Vincent-Stragier opened this issue 1 year ago • 3 comments

Hello,

Do you think it would make sense to integrate petals somehow in the Oobabooga web UI?

Regards, Vincent

Vincent-Stragier avatar Aug 04 '23 12:08 Vincent-Stragier

Hi @Vincent-Stragier,

Sure, I'd be happy to see this happen!

borzunov avatar Aug 06 '23 13:08 borzunov

For reference @Mathnerd314 is working on this issue (see his fork of Oobabooga's text generation webui), more information on Discord. You can already try his implementation using his Colab notebook.

P.S.: Thanks for the ping @borzunov

Vincent-Stragier avatar Aug 26 '23 09:08 Vincent-Stragier

Basic support is available in this PR: https://github.com/oobabooga/text-generation-webui/pull/3784

borzunov avatar Sep 19 '23 22:09 borzunov