Asher Zhang comments

Results 4 comments of


                                            Asher Zhang

[RFC]: Mooncake-Conductor: Design and Implementation of a Global Scheduler Module for KV-Cache-Centric Disaggregated Architecture

The five aforementioned scheduling systems exhibit distinct design philosophies and primary focuses: • The **Mooncake Conductor** assumes the most comprehensive role. It functions as a system-level master planner, orchestrating and...

[RFC]: Mooncake-Conductor: Design and Implementation of a Global Scheduler Module for KV-Cache-Centric Disaggregated Architecture

> Hi [@Asher-XunZhang](https://github.com/Asher-XunZhang). Thank you for your comprehensive proposal! I understand that building the Conductor is a large-scale effort, but also a highly meaningful one. I'd like to ask a...

[RFC]: Mooncake-Conductor: Design and Implementation of a Global Scheduler Module for KV-Cache-Centric Disaggregated Architecture

> > > Hi [@Asher-XunZhang](https://github.com/Asher-XunZhang). Thank you for your comprehensive proposal! I understand that building the Conductor is a large-scale effort, but also a highly meaningful one. I'd like to...

[RFC]: Mooncake-Conductor: Design and Implementation of a Global Scheduler Module for KV-Cache-Centric Disaggregated Architecture

> There are lots of protential algorithms for the Global Scheduler, the most important thing is providing a way to lookup the cache (i.e. `query_global_prefix_tree`), I suggest Mooncake provides a...