mnn-llm icon indicating copy to clipboard operation
mnn-llm copied to clipboard

Published 20 hours ago • verified publisher icon wangzhaode

Support MPI distribute computation over machine cluster

Open hyperbolic-c opened this issue 10 months ago • 0 comments

Is it possible to use MPI to distribute the computation over a cluster of machines ? This feature let us deploy larger models than would otherwise fit into RAM on a single machine. Thanks for your reply.

hyperbolic-c avatar Apr 22 '24 03:04 hyperbolic-c