Learn/Core Concept How does knowledge distillation shrink models? A big 'teacher' model generates outputs that train a much smaller 'student' model to mimic its behaviour on a narrow task. Needle distils Gemini into a 26M parameter function-caller small enough to fine-tune on a laptop and run on watches. QuantisationFine-tuning |