visheratin-pai
visheratin-pai
I started getting this error with PyTorch engine in the latest release for Qwen2-VL model. I get the error with batch size >= 6. When batch size is 1, everything...
> https://github.com/grimoire/lmdeploy/tree/fix-vl-graphcapture I have set the capture mode to thread_local, which might fix the bug. Seems like it is branched not from the latest version but from 0.4.2. When installing,...
Sorry, forgot to switch branches! Yes, the issue doesn't occur when using the correct branch.