Preprint 2026
Beyond Teacher Assignment: Domain-Normalized Multi-Teacher On-Policy Distillation
Label routing decides which teacher supervises a prompt, but not how strongly that teacher's feedback counts. Normalizing the feedback scale per domain adds 1.2–3.1 points over label routing, across 2B, 4B and 9B students.