Distributed GPU serving API petals.ml integration

[sapcode]

Discussed in https://github.com/IntelligenzaArtificiale/Free-Auto-GPT/discussions/127

^{Originally posted by sapcode May 28, 2023} Thank you very much for your work and publishing!!

@IntelligenzaArtificiale could you please look into this http://petals.ml and this example https://github.com/bigscience-workshop/petals/blob/main/examples/prompt-tuning-personachat.ipynb If you can integrate that, it will allow distributed GPU serving community free models without any paid API needs... Here is a how to spawn own GPU swarm https://github.com/bigscience-workshop/petals/wiki/Launch-your-own-swarm