aimet icon indicating copy to clipboard operation
aimet copied to clipboard

Published 20 hours ago • verified publisher icon quic

Plans & roadmad after EexcuTorch announcement

Open escorciav opened this issue 1 year ago • 3 comments

Hi!

Am I the only one wondering what will happen to AIMET as per ExecuTorch announcement?

  1. Did AIMET core/maintainers dev participate in the development? It seems that the Qualcomm:QNN (AI Direct Engine SDK) team did. However, as mentioned in other issues there is not a super smooth synergy between AIMET & QNN.
  2. Could anyone shed light about similarity/overlap, differences, or synergies between the scopes of AIMET & ExecuTorch? AFAIU AIMET focuses on quantization at the high-level, and it didn't intend to go down the stack as ExecuTorch does.
  3. List pros/cons of each approach ExecuTorch & AIMET.

:confounded: Too much uncertainty? Perhaps you want to interact with more PyTorch:ExecuTorch dev

Cheers!

escorciav avatar Nov 08 '23 13:11 escorciav

Hi @escorciav, thanks for reaching out!

Let me try to address some of the question you have raised.

ExecuTorch QNN integration is a preliminary effort to support a backend for Qualcomm devices. Currently, there is some overlap with some of the quantization functionality. the AIMET team is evaluating ExecuTorch internally and do anticipate that we will harmonize some the capabilities available w/ ExecuTorch with AIMET standalone, we do not have timeline to share at the moment.

from pros/cons standpoint, we still have to fully analyze the ExecuTorch framework but at high-level we except better alignment and potentially performance benefits with the new framework while some advanced AIMET feature might not be feasible to support. I expect we will be able provide more guidelines as we go through this exercise.

quic-sendilk avatar Nov 08 '23 18:11 quic-sendilk

Thanks for chiming in, and providing more info about how you (& afaiu the team) is approaching it. Let's keep in touch via Pytorch Forum. Feel free to close the issue :), I'll leave it open as it might motivate other users to participate, and share their opinions.

escorciav avatar Nov 09 '23 12:11 escorciav

@quic-sendilk any news? A quarter+ has passed.

  1. I wondered if the "hardware simulation" parts of AIMET will be brought to executorch?
    1. Perhaps, it'd be relevant to provide brief (or detailed) technical details about the hardware simulation.
    2. saying so as #2642 mentions that tools like HwAwareQuantSim aren't public.
  2. Can we follow the roadmap somewhere?

escorciav avatar Mar 14 '24 13:03 escorciav