Distillation Won't Save Bad Models
20:48–21:42 · 53s
Asked to weigh in on Alibaba’s alleged "distillation attacks," Clement says everyone distills from better models and drops the zinger, “If you suck, you suck with or without distillation,” arguing the practice isn’t what makes or breaks a lab.