pipecat
pipecat copied to clipboard
WIP: Fly server
This adds another example server (fly-server.py
) that uses fly.io's API to spin up a new Fly Machine for every new bot, instead of using a python subprocess in the web server itself. This will allow us to use Fly's new beefier GPU instances if we want to run local models in the cloud.
I'm putting this here now so I can hopefully remember to come back around to it before or after the hackathon. :)