InferLLM icon indicating copy to clipboard operation
InferLLM copied to clipboard

Published 20 hours ago • verified publisher icon MegEngine

python API support

Open lucasjinreal opened this issue 2 years ago • 4 comments

Hi, any plan on support python API?

lucasjinreal avatar May 10 '23 05:05 lucasjinreal

there is only one header file, supporting python api is easy

chenqy4933 avatar May 11 '23 01:05 chenqy4933

实现的思路应该是参考li-plus/chatglm.cpp的pybind的写法，将c++的对象暴露给python使用

lloydzhou avatar Jul 05 '23 02:07 lloydzhou

直接把 include/model.h 这个头文件的接口暴露给python就可以了

chenqy4933 avatar Jul 05 '23 02:07 chenqy4933

怎么暴露呢，请问大佬能给个具体的代码吗？谢谢！

JaydenGaoXunYi avatar Feb 15 '24 16:02 JaydenGaoXunYi