InternLM-XComposer icon indicating copy to clipboard operation
InternLM-XComposer copied to clipboard

About the acceleration frame work.

Open Yxxxb opened this issue 2 years ago • 0 comments

Hi!

I wonder if you have tried to deploy any acceleration or memory saving framework for InternLM-XComposer? like vLLM. If so can you provide code or possible solution?

Thanks!

Yxxxb avatar Mar 09 '24 08:03 Yxxxb