PowerInfer icon indicating copy to clipboard operation
PowerInfer copied to clipboard

Published 20 hours ago • verified publisher icon SJTU-IPADS

请问powerinfer能否兼容llama.cpp的模型呢

Open mailonghua opened this issue 7 months ago • 0 comments

Powerinfer最好的想过是llm relu + llm predictor的形式构成 能否兼容llama.cpp的模型呢？如果不能兼容，主要问题点在哪里呢

mailonghua avatar Jul 05 '24 02:07 mailonghua