Paper page - Filter, Then Reweight: Rethinking Optimization Granularity in On-Policy Distillation
…Rethinking Optimization Granularity in On-Policy Distillation Published on Jun 1 Submitted by Hangjie Yuan on Jun 4 Tsinghua University Authors: , , , , , , , , Abstract FiRe-OPD improves on-policy distillation in large language models…