Lessons
1
Skip connections: the residual learning framework
2
ResNet: architecture and training insights
3
Bottleneck blocks and 1×1 convolutions
4
DenseNet: dense connections
5
Efficient architectures: MobileNet and EfficientNet
6
Architecture design principles
7
Vision Transformers: applying attention to images
8
From CNNs to ViTs: what changed