Pre-training
The initial stage where an AI model learns general patterns from large amounts of data before being fine-tuned.
Help me explain to...
K–5th
Pre-training is like learning the basics before school starts, like shapes, numbers, and ABCs.
6–8th
Before the AI learns a specific job, it gets general practice first. That’s called pre-training.
9–12th
Pre-training is when a model is exposed to broad datasets to learn language or visual patterns. It builds a foundation before specific fine-tuning.
Expeditions
K–5th
Let students “train” on simple tasks first before doing the main game. Then connect to how AI pre-trains.
6–8th
Compare a general reading warm-up to jumping into a specific assignment. Discuss how AI benefits from similar prep.
9–12th
Examine pre-trained models vs. fine-tuned ones. Explore transferability and limits.
Share Term
