YaLM-100B icon indicating copy to clipboard operation
YaLM-100B copied to clipboard

Run on networked nodes

Open ExtraE113 opened this issue 2 years ago • 0 comments

Thanks for open-sourcing this! Because the GPU ram requirements are so high, it's hard to rent a large enough single node from any of the major cloud providers. How can you run it in inference mode networked between multiple physical machines?

Thanks!

ExtraE113 avatar Jun 28 '22 02:06 ExtraE113