Jiang Long

icon indicating a website link https://jlcoo.github.io icon indicating an email [email protected]

icon company UESTC icon location China icon location a student of control engineering and science

Results 1 comments of Jiang Long

Do LLM Cache Support V100 hardware?

@DwyaneShi Thanks for the update! I’m really looking forward to the support for more attention backends. I’m wondering if the distributed kv cache offloading feature with the support for more...