Adding SelfAttention to a Convolutional Neural Network PyTorch Deep Learning Tutorial
>> YOUR LINK HERE: ___ http://youtube.com/watch?v=-N-NBerVBrQ
TIMESTAMPS: • 0:00 Introduction • 0:22 Attention Mechanism Overview • 1:20 Self-Attention Introduction • 3:02 CNN Limitations • 4:09 Using Attention in CNNs • 6:30 Attention Integration in CNN • 9:06 Learnable Scale Parameter • 10:14 Attention Implementation • 12:52 Performance Comparison • 14:10 Attention Map Visualization • 14:29 Conclusion • In this video I show how we can add Self-Attention to a CNN in order to improve the performance of our classifier! • Donations • https://www.buymeacoffee.com/lukeditria • The corresponding code is available here! (Section 13) • https://github.com/LukeDitria/pytorch... • Discord Server: • / discord
#############################