regisss
regisss
This should work with Transformers v4.51, can you paste here the whole error message? Phi3 is not part of our [list of validated models](https://github.com/huggingface/optimum-habana?tab=readme-ov-file#transformers) so it's not surprising that it...
You can use optimum-habana 1.18.1 to have compatibility with transformers 4.51. But optimum-habana 1.18.0 should be compatible with synapse 1.21 too. What is the output of `pip show transformers`? Phi3...
What is the code you ran to perform inference with Qwen3?
Which checkpoint of Qwen2.5 did you use?
Would the goal be to build a new serving framework focusing on video generation?
> are there any existing scripts/frameworks available to serve video models efficiently on Gaudi? Not that I'm aware of. We do have an example script for performing text-to-video and image-to-video...
Do you mean "workarounds" related to the pipeline implementation? Or something else?
Can you describe a bit more what you would like the pipeline to do please?
Can you explain more how this relates to optimum-habana please?
> Optimum-habana is also maintaining trl for the fine-tuning support on Gaudi. The vLLM integration with trl allows trl to send updated weights to vLLM (policy model). I can't launch...