Mooncake icon indicating copy to clipboard operation
Mooncake copied to clipboard
Published 1 month ago • verified publisher icon kvcache-ai

[TE] feat: support send/recv API for tensor transfer

Open stmatengss opened this issue 7 months ago • 2 comments

stmatengss avatar Jun 11 '25 09:06 stmatengss

Code looks good to me! Just need to get the CI passing before we can merge

xiaguan avatar Jun 12 '25 06:06 xiaguan

TODO:

  1. Reduce serialization overhead
  2. Should replace zmq with a higher-performance notification mechanism.
  3. one-to-many send, like broadcast.

stmatengss avatar Jun 12 '25 06:06 stmatengss