Distillation Can Make AI Models Smaller and Cheaper

A fundamental technique lets researchers use a big, expensive model to train another model for less.

Source