MNIST_AttentionMap icon indicating copy to clipboard operation
MNIST_AttentionMap copied to clipboard

Attention mechanism with MNIST dataset

[TensorFlow] Attention mechanism with MNIST dataset

Usage

$ python run.py

Result

Training

Loss graph.

Test

Each figure shows input digit, attention map, and overlapped image sequentially.

Further usage

The further usages. Detecting the location of digits can be conducted using an attention map.

Requirements

  • TensorFlow 2.3.0
  • Numpy 1.18.5

Additional Resources

[1] Simple attention mechanism test by Myung Jin Kim