mirror of
https://github.com/wassname/evil_MoE.git
synced 2026-06-27 17:15:58 +08:00
93c862bb2e
select = routing precision = hack_supp - solve_supp on the knob (held-out val, knob-ON vs knob-OFF, same split). 1.0 = removes all hacking at no solve cost. Sanity: vanilla=0.00 (no knob), base=blank (no knob-on signal), per-token=0.96. hack_supp = (vanilla - hack)/vanilla ; solve_uplift = (solve - base)/(ceiling - base), the floor->ceiling normalized fractions (ceiling provisional=paper 0.223, FIXME job 24). The earlier "solve suppression ~50%" was a train/test artifact; the knob's true solve cost (select's solve_supp term) is near zero -- selectivity is high. Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>