pipecat icon indicating copy to clipboard operation
pipecat copied to clipboard

Deployment examples: What do you want to see?

Open chadbailey59 opened this issue 1 year ago • 9 comments
trafficstars

We want to build out some code and examples to make it easier to deploy Pipecat bots. Right now, we're looking at the following services:

  • Hugging Face Spaces
  • runpod.io
  • fly.io
  • Heroku
  • Cloudflare Workers

Right now, the basic structure looks like a Dockerfile running a FastAPI server that serves a static HTML frontend UI. That server also spins up bots on demand in threads. We're still figuring out how to handle Cloudflare Workers.

Where else do you want to be able to run Pipecat bots? Is there another approach that makes more sense to you?

chadbailey59 avatar May 17 '24 16:05 chadbailey59

AWS Self Hosted Ubuntu via Docker with some sort of secure front end authentication but sounds like that’s covered??

mynumu avatar May 18 '24 10:05 mynumu

Docker containers work well, and a general web front-end approach to auth is probably the right thing. But it depends on how you'll connect people to your Pipecat bots. Feel free to provide more details. @jptaylor probably also has thoughts.

kwindla avatar May 18 '24 20:05 kwindla

+1 for Runpod

gaceladri avatar Jun 19 '24 14:06 gaceladri

Hi @jptaylor,

Thank you for adding the fly.io deployment example. It's a great addition to the project. I was wondering if you could also provide a client example? Specifically, I'm not very familiar with sending voice data over curl requests or how it should work with Daily rooms. An example demonstrating this would be extremely helpful for users like me who are new to this aspect of the implementation.

If you have the time, a simple client-side example would greatly enhance the documentation and make it easier for others to get started with the project.

Thanks again for your contributions!

gaceladri avatar Jul 02 '24 12:07 gaceladri

@gaceladri it may be worth checking out the storytelling chatbot as it includes a web client that you can use to interface with your bot.

Alternatively, we have a somewhat WIP but fully functional example web client here: https://github.com/pipecat-ai/web-client-ui

I think your broader point, however, is that it would be good to have an feature complete example that shows how all these things fit together. I'll get to work on that.

jptaylor avatar Jul 02 '24 13:07 jptaylor

@jptaylor Oh, lovely! Thank you for the helpful suggestions! The storytelling chatbot and the web client UI examples should provide me with the guidance I need. I appreciate your consideration of a more comprehensive example as well.

gaceladri avatar Jul 02 '24 15:07 gaceladri

Azure and AWS!

TomTom101 avatar Jul 14 '24 09:07 TomTom101

@jptaylor The web-client-ui is fantastic and is exactly what I have been looking for. Before, I used a trimmed down version of the storybot example which is kinda hard if your not really into frontend dev like myself. It was much easier to trim web-client-ui to my needs. Would love to see this evolve!

TomTom101 avatar Jul 14 '24 09:07 TomTom101

Is Render a possible option?

chrisnolet avatar Jul 31 '24 07:07 chrisnolet

@chadbailey59 closing this because it is stale. feel free to open a new issue (preferably one issue per deployment example request).

vipyne avatar Oct 21 '24 23:10 vipyne

celery task for bots instead of an entire container or bot py?

vivekdurai avatar Jan 10 '25 06:01 vivekdurai