hls4ml icon indicating copy to clipboard operation
hls4ml copied to clipboard
verified publisher icon fastmachinelearning

Does hls4ml currently support transform architectures?

Open LmDeng0 opened this issue 1 year ago • 5 comments

Does hls4ml currently support transform architectures now? I saw in the paper Ultra Fast Transformers on FPGAs for Particle Physics Experiments that MHA support will be made available in the near future.

LmDeng0 avatar Oct 28 '24 14:10 LmDeng0

It's not available yet, we expect a pull request integrating this code in the next weeks.

JanFSchulte avatar Oct 28 '24 14:10 JanFSchulte

I'm looking forward to it, thank you!

LmDeng0 avatar Oct 28 '24 14:10 LmDeng0

Greetings @JanFSchulte, any chance this integration has happened already since Oct? Thanks

vmayoral avatar Jan 07 '25 07:01 vmayoral

Hello,

Has the integration happened since October 2024?

ChloeCarbonniere avatar Apr 09 '25 13:04 ChloeCarbonniere

Some experimental support in PRs: #1163 for multi-head attention and #1110 for LayerNorm.

bo3z avatar Apr 09 '25 14:04 bo3z