Nanoflow icon indicating copy to clipboard operation
Nanoflow copied to clipboard

I tried to run Qwen1.5-0.5B-Chat-m model with NanoFLow,but I'm not sure how to adjust "model_configs"

Open yxy1995123 opened this issue 9 months ago • 1 comments

I tried to run Qwen1.5-0.5B-Chat-m model with NanoFLow,but I'm not sure how to adjust "model_configs". The details is shown:

Image

The error is : terminate called after throwing an instance of 'std::logic_error' what(): basic_string::_M_construct null not valid

yxy1995123 avatar Mar 17 '25 06:03 yxy1995123

May you try again in our codebase now? Since we have upgraded our codebase from c++ to python so that it shoule be easier to implement a new model in the framework now. And we would be so appreciate for you if you could implement Qwen model and make a pull request.

Wazrrr avatar Aug 11 '25 20:08 Wazrrr