Search Results
2 results for “knowledge distillation”
Infrastructure
Knowledge Distillation
Knowledge distillation is a model compression technique in which a smaller student neural network is trained to replicate the behaviour of a larger, more capable teacher model, enabling deployment of efficient models that approximate teacher-level performance.
6 min readUpdated May 2026
Infrastructure
Model Compression
Model compression is a set of techniques that reduce the size, memory footprint, and computational cost of machine learning models while preserving predictive accuracy, enabling deployment on resource-constrained hardware.
6 min readUpdated June 2026