Collections and Understanding
- What is attention mechanism?
- What’s the difference between Soft attention and Hard attention?
Reference:
- Deep Learning: Progress in Theory and Attention Mechanisms
- Attention and Memory in Deep Learning and NLP
Further Reading
- MeteMind DMN_Dynamic Memory Nets
- NVIDIA Introduction to Neural Machine Translation with GPUs PART1
- NVIDIA Introduction to Neural Machine Translation with GPUs PART2
- NVIDIA Introduction to Neural Machine Translation with GPUs PART3
- HEURITECH – LE BLOG ATTENTION MECHANISM