classiq-library icon indicating copy to clipboard operation
classiq-library copied to clipboard

Quantum Vision Transformer - Paper Implementation

Open neogyk opened this issue 10 months ago • 9 comments

The Abstract:

The Vision Transformer is a very popular ML architecture in Computer Vision. It allows to perform the classification, regression and data generation in effective and efficient way. In this task we will implement the Quantum version of the vision transformer and will train it using the HEP data in order to simulate the EM shower in the detector.

Image

Phases:

  1. Review the existing application of the quantum vision transformer.
  2. Implement the quantum vision transformer and training schema.
  3. Use the HEP data for the quantum vision transformer to perform the classification task.
  4. Use the HEP data to perform the generation.

Resources:

  1. Quantum Vision Transformer
  2. Quantum Vision Transformer
  3. Quantum Vision Transformers for Quark-Gluon Classification
  4. Hybrid Quantum Vision Transformers for Event Classification in High Energy Physics
  5. End-to-End Quantum Vision Transformer: Towards Practical Quantum Speedup in Large-Scale Models

neogyk avatar Mar 04 '25 18:03 neogyk

Sounds interesting @neogyk ! could you please provide more technical details on the implementation? will you use Classiq integration with PyTorch? What kind of quantum operations are you going to use (you can attach a layout of the quantum circuit for example, as well as the full hybrid network scheme).

TomerGoldfriend avatar Mar 05 '25 08:03 TomerGoldfriend

@neogyk we are assigning you to this issue. Please note that we accept high-quality implementations to our repository and will be glad to accept a contribution that meets our standards.

Feel free to reach out to the community for any questions! Good luck!

TomerGoldfriend avatar Mar 06 '25 12:03 TomerGoldfriend

Hi @neogyk, what is the status of this? Are you still working on the implementation?

TaliCohn avatar Apr 01 '25 10:04 TaliCohn

Dear @TaliCohn, I am still working, the code is not yet finalised.

neogyk avatar Apr 09 '25 08:04 neogyk

@neogyk, No problem, how long do you think you will need? I'll update the deadline

TaliCohn avatar Apr 10 '25 08:04 TaliCohn

@TaliCohn, tomorrow it's will be ready

neogyk avatar Apr 11 '25 09:04 neogyk

@neogyk any update here?

TaliCohn avatar Apr 22 '25 10:04 TaliCohn

Dear @TaliCohn . I have finished the implementation of the QVT, trained it using MNIST dataset. The backpropagation is very slow, it's very hard to achieve the results with the current efficiency.

neogyk avatar Apr 22 '25 22:04 neogyk

@TomerGoldfriend Please review the PR

TaliCohn avatar Apr 23 '25 16:04 TaliCohn