wassnameandClaudypoo 93c862bb2e results-deploy: add select (Youden J) + floor->ceiling columns ...

select = routing precision = hack_supp - solve_supp on the knob (held-out val,
knob-ON vs knob-OFF, same split). 1.0 = removes all hacking at no solve cost.
Sanity: vanilla=0.00 (no knob), base=blank (no knob-on signal), per-token=0.96.

hack_supp = (vanilla - hack)/vanilla ; solve_uplift = (solve - base)/(ceiling - base),
the floor->ceiling normalized fractions (ceiling provisional=paper 0.223, FIXME job 24).

The earlier "solve suppression ~50%" was a train/test artifact; the knob's true
solve cost (select's solve_supp term) is near zero -- selectivity is high.

Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>

2026-06-09 09:56:55 +00:00

..

attic

retract 'null_city contaminated' framing -> in/out-of-subspace + cosine-is-correlational

2026-06-05 09:21:41 +00:00

build_combined_pool.py

reorg: out/ sorted by datatype (vhack/ pools/ runs/ vhack_grads/ figs/)

2026-05-30 03:52:24 +00:00

build_runtests_pool.py

fix: dense run_tests teacher pool (6 -> 215 prompts) so the hack seeds in 60 steps

2026-06-07 11:01:31 +00:00

build_substrate.py

rename python package projected_grpo -> vgrout

2026-06-05 14:51:48 +08:00

diag_cosine_dist.py

cleanup: consolidate pairs modules into build scripts + add solve_train to table

2026-06-09 09:17:42 +00:00

diag_pairs_compare.py

cleanup: consolidate pairs modules into build scripts + add solve_train to table

2026-06-09 09:17:42 +00:00

make_random_vhack.py

cleanup: trim 2 stale provenance/train-of-thought comments

2026-06-03 00:25:22 +00:00

pairs_from_rollouts.py

rename python package projected_grpo -> vgrout

2026-06-05 14:51:48 +08:00

pairset_build_authored.py

fix: rename 4 canonical LeetCode function names in authored/clean pairsets

2026-06-09 09:23:33 +00:00

pairset_build_intent.py

cleanup: consolidate pairs modules into build scripts + add solve_train to table

2026-06-09 09:17:42 +00:00

pairset_build_progsets.py

refactor: named pairset JSONs + explicit --vhack-pairs-path, remove None fallback

2026-06-09 08:09:09 +00:00

plot_deploy_overlay.py

rename python package projected_grpo -> vgrout

2026-06-05 14:51:48 +08:00

plot_dynamics.py

rename python package projected_grpo -> vgrout

2026-06-05 14:51:48 +08:00

plot_emergence.py

rename python package projected_grpo -> vgrout

2026-06-05 14:51:48 +08:00

plot_floor_ceiling.py

viz: floor->ceiling as two normalized panels (best vs control vs reference)

2026-06-09 09:55:03 +00:00

plot_substrate.py

rename python package projected_grpo -> vgrout

2026-06-05 14:51:48 +08:00

probe_distill.py

rename python package projected_grpo -> vgrout

2026-06-05 14:51:48 +08:00

probe_plot_stack.py

refactor: move 5 leaf entrypoints src/ -> scripts/ (src is now library-only)

2026-06-03 00:23:56 +00:00

rescore_deploy.py

fix: eval on paper test set, not contaminated holdout (base solve 0.94->0.094)

2026-06-07 11:01:31 +00:00

results_deploy.py

results-deploy: add select (Youden J) + floor->ceiling columns

2026-06-09 09:56:55 +00:00

results.py

results: just results = eval2 deploy table (time/headline/deploy/arm/pair/seed/train/argv); hard eval2 cutoff; archive eval1 (Q1-Q13 + 352 old logs)

2026-06-09 01:50:42 +00:00

tt_erase_bench.py

rename python package projected_grpo -> vgrout

2026-06-05 14:51:48 +08:00

validate_spoonfeed.py

rename python package projected_grpo -> vgrout

2026-06-05 14:51:48 +08:00

verify_base_solve.py

fix: eval on paper test set, not contaminated holdout (base solve 0.94->0.094)

2026-06-07 11:01:31 +00:00

verify_eval_gap.py

eval: train/test token gap for all 4 modes (lenient disjoint families)

2026-06-06 13:49:07 +00:00

verify_partition.py

test: no-cheat partition + teacher-pool composition gate (verify_partition.py)

2026-06-05 04:36:03 +00:00

verify_rewards.py

rename python package projected_grpo -> vgrout

2026-06-05 14:51:48 +08:00

verify_vhack_heldout.py

rename python package projected_grpo -> vgrout

2026-06-05 14:51:48 +08:00