attention-mechanism-keras

This repo implements the attention mechanism in keras.

To do list

• [x] Attention in Dense Network
• [x] Attention in RNN Network

Attention in Dense Network

Use attention mechanism to get which feature shuold be paid more attention. A Dense layer is used to get the probs.Here is the probs plot.

Attention in RNN Network

Use attention mechanism to get which timesteps shuold be paid more attention( of cause, you can switch to which features shuold be paid more attention).Here is the probs plot.