openvino
openvino copied to clipboard
[TRANSFORMATIONS] RoPE support different dimensions options for flux.1-schnell
Details:
The flux.1-schnell model has changes after updating diffusers from 0.33.1 to 0.35.2 which caused another dimensions arrangement for RoPE in the model: [batch, num_heads, -1, head_size] -> [batch, -1, num_heads, head_size], so the incorrect dimension was captured as num_heads.
Fix it by having 2 separate patterns supporting both cases.
Tickets:
Signed-off-by: Andrii Staikov [email protected]