CPP Model API

Open halimabergaoui opened this issue 2 years ago • 6 comments

Hello, Is there a way to use qwen API https://github.com/QwenLM/Qwen/blob/main/openai_api.py on the cpp model?

Oct 10 '23 11:10 halimabergaoui

I will add openai_api within this week.

Oct 16 '23 06:10 simonJJJ

API功能预计啥时候可以推出，期待，不然只能本机cmd窗口玩玩无法实用

Oct 23 '23 05:10 AppleJunJiang

官方更新api和server速度太慢了

Oct 31 '23 04:10 AppleJunJiang

I will add openai_api within this week.

how about this week？

Nov 08 '23 01:11 YuRong-Lin

爱你不容易啊, qwen_1.8B, 一个API难

Jan 04 '24 01:01 chuanzhubin

用llama.cpp吧。都有了。😄

Jan 04 '24 01:01 sweetcard