Study Target:
- understanding of the current state of machine learning development
- try coding
Studied Contents:
- Literature:A Survey of Transformers
- Literature:Attention Is All You Need
- Literature:Transformers in Vision: A Survey
- Literature:AN IMAGE IS WORTH 16X16 WORDS-TRANSFORMERS FOR IMAGE RECOGNITION AT SCALE
- Video:Transformers in Vision: From Zero to Hero
- Videos:The Transformer explained by Ms. Coffee Bean
- Video:Intuition Behind Self-Attention Mechanism in Transformer Networks
- Video:Vision Transformer in PyTorch