Transfer Learning
Standing on the shoulders of pretrained giants
7 lessons · 88 min total ·
Prereq: Neural Networks , Convolutional Networks , Attention & Transformers
Start unit
Lessons
1
Pre-training and the feature hierarchy
2
Feature extraction vs. full fine-tuning
3
Domain adaptation: closing the gap
4
LoRA: low-rank adaptation
5
Other PEFT methods: prefix tuning and adapters
6
Few-shot and zero-shot learning
7
Transfer learning in practice