openvino icon indicating copy to clipboard operation
openvino copied to clipboard
verified publisher icon openvinotoolkit

[GPU] Add initial SDPA implementation

Open sshlyapn opened this issue 1 year ago • 0 comments

Details:

  • Add initial SDPA implementation

Remaining tasks:

  1. Input/Output Transpose fusion support - https://github.com/openvinotoolkit/openvino/pull/24475
  2. Indirect inputs support
  3. GQA related optimization (Broadcast fusion)

sshlyapn avatar May 10 '24 13:05 sshlyapn