EnergonAI icon indicating copy to clipboard operation
EnergonAI copied to clipboard
verified publisher icon hpcaitech

How to inference BLOOM-176B by multi-node multi-card？

Open vicwer opened this issue 2 years ago • 2 comments

HI，Thank you very much for your work, I can now do bloom-560m inference on single node 4 cards by example, how to use multi-node multi-card (like 4x4x32GB v100GPU) inference bloom-176b？

vicwer avatar Feb 16 '23 08:02 vicwer

same asking here

sharlec avatar Apr 26 '23 23:04 sharlec

me too! how to use multi-node multi-card inference? Does Energonai support ?

chenbo90 avatar Sep 21 '23 13:09 chenbo90