griptape icon indicating copy to clipboard operation
griptape copied to clipboard

Explore support for local StableDiffusion models

Open andrewfrench opened this issue 1 year ago • 6 comments

Is your feature request related to a problem? Please describe. Some organizations must use self-hosted or local model deployments. Some drivers might support self-hosted models through configuration of the API endpoint, but local models might require additional work.

Describe the solution you'd like Clearly defined and documented support for local and self-hosted models.

Describe alternatives you've considered n/a

Additional context n/a

andrewfrench avatar Dec 14 '23 20:12 andrewfrench

Thanks @andrewfrench 🙏

mgcollie avatar Dec 15 '23 00:12 mgcollie

Is there a particular method of interacting with local models you're interested in? We're already looking into support for Text Generation Interface via #89 which should allow for local models.

collindutter avatar Dec 18 '23 23:12 collindutter

@collindutter I was thinking of maybe creating a driver for this: https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/API for interacting with stable-diffusion locally in particular.

mgcollie avatar Dec 21 '23 18:12 mgcollie

@collindutter maybe I can just use griptapes RestApiClient to do what I need. I'll poke around at that this afternoon

mgcollie avatar Dec 22 '23 17:12 mgcollie

yeah that works.

mgcollie avatar Dec 22 '23 22:12 mgcollie

@mgcollie the RestApiClient, or even a custom Tool, sounds like a suitable solution for now. But lets keep this issue open so we can continue evaluating a long term solution here.

Regarding the Driver, I'd like to avoid reliance on WebUI, feels a little off to me. What are some other options for getting SD running locally?

collindutter avatar Dec 23 '23 00:12 collindutter

Closing as implemented in #1018.

andrewfrench avatar Oct 14 '24 16:10 andrewfrench