From c1388e5325917eda58bd91bf9ce3cf266a5a4b84 Mon Sep 17 00:00:00 2001 From: wassname Date: Wed, 3 Jun 2026 01:42:03 +0000 Subject: [PATCH] paper: title -> question form 'Can We Quarantine Reward Hacking with a Reward-Hacking Representation?' Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com> --- docs/writeup/main.tex | 13 +++++++------ 1 file changed, 7 insertions(+), 6 deletions(-) diff --git a/docs/writeup/main.tex b/docs/writeup/main.tex index 60686c7..d283588 100644 --- a/docs/writeup/main.tex +++ b/docs/writeup/main.tex @@ -20,11 +20,12 @@ % TODO-marker: renders red in the PDF and is grep-able by `just paper-qc`. \newcommand{\TODO}[1]{{\color{red}\textbf{[TODO: #1]}}} -% Title (user-chosen, AFK 2026-06-03): "quarantine" = the deletable delta_S_hack -% knob; "routing gradients" = post-backward parameter-gradient routing (SGTM -% family, not Cloud's activation detach); "hacking representation" = the -% RepE-extracted hack direction. Tighter variant if wanted: "...with a -% Reward-Hack Representation". Do NOT title it "label-free" -- our pairs ARE +% Title (user-chosen, AFK 2026-06-03): question form. "quarantine" = the +% deletable delta_S_hack knob (our coinage; SGTM/Cloud don't use it); the +% doubled "reward-hacking" is the hook -- the hack's own representation is what +% cages it. "representation" = RepE-extracted hack direction (NOT activations). +% Contrast with the near-twin huang2026directional: they keep a TRUSTED direction; +% we remove a HACK representation. Do NOT title it "label-free" -- our pairs ARE % labels; the scoped backable claim ("held-out hacks suppressed with zero labels % of their own") needs A5 + a hacked_E==0-on-held-out check first. % OPEN (flagged to user): contribution 2 implies the pairs can be synthetic @@ -32,7 +33,7 @@ % (teacher elicitation, A5), but the HEADLINE v_hack used hand-authored % prog_wide/prog_wider (scripts/attic/make_dataset_pairsets.py). Either re-extract % the headline from synthetic pairs or describe the hand-authored set honestly. -\title{Quarantining Reward-Hacking Gradients with a Hacking Representation} +\title{Can We Quarantine Reward Hacking with a Reward-Hacking Representation?} % Anonymous for submission. Add \nipsfinalcopy + real authors for camera-ready. \author{Anonymous Author(s)\\ Affiliation\\ \texttt{email}}