Learn/Core Concept How does knowledge distillation work? Knowledge distillation trains a smaller model to copy a larger model’s softened output probabilities. It can shrink Aurora-style local deployments while retaining useful behaviour, cutting memory, latency, and hosting cost. QuantisationPruning |