expression, noun
knowledge distillation
Technical term in machine learning where a smaller model (student) is trained to mimic a larger model (teacher).
知識の蒸留は、大規模モデルの知識を小規模モデルに移す手法です。
Knowledge distillation is a technique to transfer the knowledge of a large model to a smaller one.
この論文では知識の蒸留を用いてモデルを軽量化した。
In this paper, they used knowledge distillation to make the model lighter.
Compound of 知識 (knowledge) + の (possessive particle) + 蒸留 (distillation). Calque of English 'knowledge distillation', a term coined in machine learning literature.