junior-zsy

> @zhuohan123 @WoosukKwon The PR is ready for review. Could you please take time to review the code? I hope it can be merged, which is very useful for large...

@WoosukKwon @zhuohan123 @Yard1 Looking forward to merging it into main. I would like to use this feature now. Thank you

@PCmoritz Hello, have you made any progress? I have also encountered such a problem

@dbogunowicz I ran the feature/demian/Whisper branch to run the Whisper model and found an error message: vllm/worker/model_runner. py, line 477, in prepare_decode Multi_modeal_input) NameError: name 'multi_modal_input' is not defined, code...

@dbogunowicz Ok, thank you. Hope it can be used soon

@js8544 Hello, is there any progress on this now? I would like to use it. Thank you

Same problem ， I used a awq quantified model to deploy services