knowledge-distillation

Model distillation trains a smaller model to imitate a larger model's outputs, often reducing cost and latency while preserving much of the behavior.