Adversarial-AutoMixup

Adversarial-AutoMixup copied to clipboard

We propose AdAutoMix, an adversarial automatic mixup augmentation approach that generates challenging samples to train a robust classifier for image classification, by alternatively optimizing the classifier and the mixup sample generator. AdAutoMix comprises two modules, a mixed example generator, and a target classifier. The mixed sample generator aims to produce hard mixed examples to challenge the target classifier while the target classifier’s aim is to learn robust features from hard mixed examples to improve generalization. To prevent the collapse of the inherent meanings of images, we further introduce an exponential moving average (EMA) teacher and cosine similarity to train AdAutoMix in an end-to-end way.

Mixed Images of Various Mixup-based Approaches.

📬 You can contact me by email: [email protected] or WeChat: xinxinxinxin_j.

If you are interested in palm or finger vein research, please contact us!

🛠 Installation

💥News! ! !💥
2024-01-18: you can clone Openmixup training "AdAutoMix"[ICLR 2024].
2023-12-19: We update some analysis tools code such as: Calibration, FGSM calibration_fgsm.py and Occlusion Robustness occlusion_robustness.py experiments, also we support a mix augmentation method "SnapMix"[AAAI 2021].
Big thanks to Siyuan Li(@Lupin1998).

🔧How to install?🔧
In fact, you can add our python file in OpenMixup.
There, you can see how to use it and the environment required. What you need to do is add or replace our files by folder inside OpenMixup, and then add the function names of the files in the __init__.py file.
You also can download or find other Mixup methods in OpenMixup("https://github.com/Westlake-AI/openmixup")
Thanks contributors: Siyuan Li(@Lupin1998), Zichen Liu(@pon7) and Zedong Wang(@Jacky1128).

Here are the commands to install OpenMixup

conda create -n openmixup python=3.8 pytorch=1.12 cudatoolkit=11.3 torchvision -c pytorch -y
conda activate openmixup
pip install openmim
mim install mmcv-full
git clone https://github.com/Westlake-AI/openmixup.git
cd openmixup
python setup.py develop

Here are the commands to git clone AdAutoMixup

git clone https://github.com/JinXins/Adversarial-AutoMixup.git

📊 Experiments

CIFAR-100

Tiny-ImageNet & ImageNet-1K(denote *)

CUB-200, FGVC-Aircraft and Standford Cars

If you want see more results, please check this Experiments.md.

😉 Citation

If you feel that our work has contributed to your research, please cite it, 🥰 and please don`t forget to cite OpenMixup if you use this project ! 🤗 Thanks.

@inproceedings{iclr2024adautomix,
      title={Adversarial AutoMixup},
      author={Huafeng Qin and Xin Jin and Yun Jiang and Mounim A. El-Yacoubi and Xinbo Gao},
      booktitle={International Conference on Learning Representations},
      year={2024},
}

@article{li2022openmixup,
  title = {OpenMixup: A Comprehensive Mixup Benchmark for Visual Classification},
  author = {Siyuan Li and Zedong Wang and Zicheng Liu and Di Wu and Cheng Tan and Stan Z. Li},
  journal = {ArXiv},
  year = {2022},
  volume = {abs/2209.04851}
}

💬 Other info

🏫 Chongqing Intelligence Perception and Block Chain Technology Key Lab, Biometric Identification Group

Head of Laboratory: Prof. Huafeng Qin. Email: [email protected]

📖 Some Publications

• Finger Vein & Palm Vein Recognition
  • Finger-Vein Quality Assessment by Representation Learning from Binary Images, 2015, ICONIP PDF
  • Deep Representation for Finger-Vein Image-Quality Assessment, 2017, TCSVT PDF
  • Deep Representation-based Feature Extraction and Recovering for Finger-Vein Verification, 2017, TIFS PDF
  • Finger-Vein Quality Assessment by Joint Representation Learning from Grayscale and Binary Images, 2018, ICPRAI PDF
  • Multi-Scale and Multi-Direction GAN for CNN-based Single Palm-Vein Identification, 2021, TIFS PDF
  • Local Attention Transformer-based Full-View Finger-Vein Identification, 2022, TCSVT PDF
  • Transformer based Defense GAN Against Palm-Vein Adversarial Attacks, 2023, TIFS PDF
  • Label Enhancement-Based Multiscale Transformer for Palm-Vein Recognition, 2023, TIM PDF
  • Adversarial Learning-based Data Augmentation for Palm-vein Identification, 2023, TCSVT PDF
  • AG-NAS: An Attention GRU-based Neural Architecture Search for Finger-Vein Recognition, 2023, TIFS PDF
  • Adversarial Masking Contrastive Learning for Vein Recognition, 2024, arXiv PDF
• Computer Vision
  • Adaptive Deep Feature Fusion for Continuous Authentication with Data Augmentation, 2022, TMC PDF
  • Memory-Augmented Autoencoder based Continuous Authentication on Smartphones with Conditional Transformer GANs, 2023, TMC PDF
  • Adversarial AutoMixup, 2024, ICLR (spotlight 5%) PDF
• Eye Movement Recognition
  • EmMixformer: Mix Transformer for Eye Movement Recognition, 2024, arXiv PDF

📝 Interest

  If you are interested in vein research (palm veins, finger veins, etc.), why not contact us and we will be happy to discuss the research or questions with you.
  Of course, we're also trying to research how we can use AI to predict and detect diseases, potentially Alzheimer's, Parkinson's, etc., but of course, this is new research for us, so we're still figuring it out.
  Email: [email protected]