Commit Graph
411 Commits
Author SHA1 Message Date
wassnameandPI[gpt-5.6-terra] 368759d65d Clarify saved 14B WVS steering paths
Co-Authored-By: PI[gpt-5.6-terra] <288921227+claudypoo@users.noreply.github.com>
2026-09-19 14:41:18 +08:00
wassnameandPI[gpt-5.6-terra] 305d8fd61a Replot 14B WVS steering from saved data
Co-authored-by: PI[gpt-5.6-terra] <288921227+claudypoo@users.noreply.github.com>
2026-09-19 14:19:32 +08:00
wassname e1078ac068 Plan an honesty-valid WVS steering rerun
Replace shared-KL dose matching and the truth-over-approval proxy with a short validated honesty axis, method-specific dose walks, disjoint Daily Dilemmas splits, and exact hook reporting.\n\nCo-Authored-By: PI/OpenAI <288921227+claudypoo@users.noreply.github.com>
2026-09-19 06:27:02 +08:00
wassnameandClaude aa3c3f7e75 Preserve the 29 raw Qwen3-14B steering artifacts
The repository-wide outputs ignore pattern also matched the semantic research
artifact directory. Force-add the JSONs containing raw lp_gather, per-item
samples, manipulation generations, doses, and resolved run config.

Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 21:41:20 +08:00
wassnameandClaude d840ebe406 Report the Qwen3-14B honesty sweep as inconclusive
Pool three read seeds, compare every coherent dose with 20 random directions,
and preserve the raw lp_gather artifacts and full run log. Several isolated WVS
doses exceed matched random displacement, but no method exceeds the held-out
honesty random p95 and VJP's source-axis cosine is -0.021.

The final map shows random controls as a cloud, retains failed-coherence doses
as faint points, and states the failed honesty-specific gate on the figure.

Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 21:41:07 +08:00
wassnameandClaude 92f25093eb Select Qwen3-14B from measured answer-slot readability
At the 64-token resample, Qwen3-14B retained mean/min answer-token mass
0.987/0.948. Qwen3-8B collapsed to 0.567/0.009 and Qwen3-4B was smaller.
Record the evidence and retain the WVS source label on the revised figure.

Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 21:13:18 +08:00
wassnameandClaude 6e9341abde Compare pooled steer paths with matched-dose random controls
The result table now reports each coherent movement against the 95th percentile
of random directions at the same signed dose, and reports whether each method's
held-out honesty effect exceeds random. Allow one Modal launch to add many
random-only seeds without repeating real method extraction.

Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 21:12:00 +08:00
wassnameandClaude c3ccf7bfb4 Pool read seeds and keep failed-coherence doses visible on the map
Draw one pooled path per real method instead of treating read seeds as distinct
interventions. Random directions remain separate controls. Doses below the
absolute pmass 0.90 gate are hollow and faint rather than silently removed;
only valid doses enter the result table and confidence intervals.

Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 21:08:46 +08:00
wassnameandClaude 0131ffff80 Record the validity gates before rerunning the steering sweep
The first 27B sweep failed its preregistered readability gate and exposed sign
and sampling bugs. Record the corrected decision rule now: absolute pmass,
held-out honesty specificity against random, matched-dose displacement, and
leave-one-item-out robustness. Also print the manipulation effect in Modal job
summaries.

Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 21:06:04 +08:00
wassnameandClaude e3e3a0462b Seed paired WVS traces and score honesty polarity before the sweep
Save lp_gather before renormalization. The previous response bootstrap paired
unrelated stochastic traces because --seed never reached torch generation.
Resetting the read seed at base and each dose supplies common random numbers.

Replace the qualitative, underspecified manipulation prompts with four held-out
true-vs-welcome questions. Their full-vocabulary log-odds orient each method's
sign; the random control receives the same sign-selection rule.

Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 21:04:15 +08:00
wassname dca887f9b8 Let the Modal recipe take a seed list; default one seed 2026-09-18 20:00:04 +08:00
wassname 3ddd06a403 Pass c-grid as one token so argparse does not read it as a flag 2026-09-18 19:55:01 +08:00
wassnameandClaude b4481f481a Pair the steer CI against base, save the answer primitive, add a manipulation check
The absolute WVS coordinate carries +-0.07 of item-set variance on a 12-item
battery, so the steer is now reported as a paired difference on the same items.
Per-dose psamples are saved, so every interval is post-processing.

The manipulation check exists because a flat map cannot be read on its own: a
vector that does nothing and a vector that culture does not respond to look the
same. Qwen3-0.6B: per-item changes are large (sd 0.18-0.38) but their signs are
coin flips (7/12 up), and random behaves the same.

Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 19:53:40 +08:00
wassnameandClaude 9109dbfe19 Open the think block for non-thinking-default templates, probe answer-slot readability
Qwen3.5 templates close an empty <think></think> by default, so the reader appended a
second <think> and the model saw </think>...<think>. enable_thinking=True fixes the
sequence; Qwen3 is unchanged (pmass 1.000 before and after).

The probe exists because Qwen3.5-0.8B reads the WVS battery at pmass 0.61-0.84, not
0.999, and a mushy readout would waste the big run.

Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 19:31:58 +08:00
wassnameandClaude 3cd62abf2a Plot honesty steer paths on the culture map, colours off the zone palette
Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 19:13:37 +08:00
wassnameandClaude f9555a5ce4 Lock the steer extra and pin the Modal image builder
Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 19:09:35 +08:00
wassnameandClaude 06389e8844 Share the WVS IW readout, add the honesty steering sweep and its Modal runner
- src/moralmaps/wvs.py: the item -> Instrument -> (X, Y) readout moved out of
  scripts/wvs_map.py so the base map and the steered run cannot drift apart
- scripts/wvs_steer_sweep.py: honesty persona axis, iso-KL calibrated doses,
  per-item positions saved so a leave-one-out holdout is post-processing
- scripts/run_modal_wvs.py: one container per (method, seed)

Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 19:01:26 +08:00
wassnameandClaude d01be44b01 Name the 27B step concretely instead of 'rung'
Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 18:52:00 +08:00
wassnameandClaude 9d5b43dc60 Plan WVS steering sweep on a large model via Modal
Co-Authored-By: Claude <288921227+claudypoo@users.noreply.github.com>
2026-09-18 18:51:33 +08:00
wassname 789829e524 Preregister Gemini Flash rubric pilot
Signed-off-by: PI[gpt-5.6-terra] <pi@local>
2026-09-18 18:39:34 +08:00
wassname 69fd56ba8c Refine WVS page introduction
Signed-off-by: PI[gpt-5.6-terra] <pi@local>
2026-09-18 18:29:32 +08:00
wassname f5bdf5643f Exclude int8 from WVS routing
Signed-off-by: PI[gpt-5.4] <pi@local>
2026-09-18 18:25:30 +08:00
wassname cc7ca18fb4 Tighten WVS page introduction
Signed-off-by: PI[gpt-5.6-terra] <pi@local>
2026-09-18 18:20:13 +08:00
wassname e32efd22ab Add Economist WVS quote
Signed-off-by: PI[gpt-5.6-terra] <pi@local>
2026-09-18 18:04:49 +08:00
wassnameandPI[k3] 2d9677f573 Record final WVS visual review
Co-Authored-By: PI[k3] <288921227+claudypoo@users.noreply.github.com>
2026-09-18 02:06:28 +08:00
wassnameandPI[k3] 3aa2a09e49 Refresh canonical WVS map integration
Co-Authored-By: PI[k3] <288921227+claudypoo@users.noreply.github.com>
2026-09-18 01:52:07 +08:00
wassnameandPI[k3] 39c9a5ce98 Qualify DeepSeek reliability interpretation
Co-Authored-By: PI[k3] <288921227+claudypoo@users.noreply.github.com>
2026-09-18 01:31:17 +08:00
wassnameandPI[k3] dfb1facd57 Audit and settle DeepSeek reliability pilot
Co-Authored-By: PI[k3] <288921227+claudypoo@users.noreply.github.com>
2026-09-18 01:25:06 +08:00
wassnameandPI[k3] 460f0d6588 Resume DeepSeek pilot after incomplete replicate
Co-Authored-By: PI[k3] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 22:38:40 +08:00
wassnameandPI[k3] 75ecb17d88 Audit OpenAI score-all-options refresh lane
Co-Authored-By: PI[k3] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 22:12:45 +08:00
wassnameandPI[openai-codex] b818cec0ba Quote DeepSeek pilot dependency constraint for Pueue
Co-Authored-By: PI[openai-codex] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 21:38:38 +08:00
wassnameandPI[openai-codex] cd1ed907b1 Record resolved DeepSeek pilot smoke config
Co-Authored-By: PI[openai-codex] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 21:37:13 +08:00
wassnameandPI[openai-codex] c1ac900486 Reuse successful DeepSeek pilot smoke record
Co-Authored-By: PI[openai-codex] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 21:36:33 +08:00
wassnameandPI[openai-codex] 1b6f2d7ef1 Add versioned DeepSeek WVS reliability pilot
Co-Authored-By: PI[openai-codex] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 21:35:20 +08:00
wassnameandPI[openai-codex] f2b321a0b2 Label latest WVS family releases from saved catalog
Co-Authored-By: PI[openai-codex] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 21:26:12 +08:00
wassnameandPI[openai-codex] a18f0ec457 Bootstrap WVS score-all-options response means
Co-Authored-By: PI[openai-codex] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 21:22:21 +08:00
wassnameandPI[openai-codex] 0f7814874a Add built Pages bundle for score-all-options refresh
Co-Authored-By: PI[openai-codex] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 21:14:38 +08:00
wassnameandPI[openai-codex] bdf593e0de Publish score-all-options map refresh and HLE data
Co-Authored-By: PI[openai-codex] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 21:13:46 +08:00
wassnameandPI[openai-codex] b444e1fcf7 Preserve canonical cache entries during recovery
Co-Authored-By: PI[openai-codex] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 19:45:55 +08:00
wassnameandPI[openai-codex] 82fa098b28 Preserve score-all-options cache across lanes
Co-Authored-By: PI[openai-codex] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 19:42:06 +08:00
wassnameandPI[openai-codex] 83741adb9c Record WVS compatibility probe in manifest
Co-Authored-By: PI[openai-codex] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 19:36:59 +08:00
wassnameandPI[openai-codex] b9141523cb Audit Muse score-all-options lane
Co-Authored-By: PI[openai-codex] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 19:33:08 +08:00
wassnameandPI[openai-codex] 99c3a28395 Abort WVS panels after first incompatible request
Co-Authored-By: PI[openai-codex] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 19:32:23 +08:00
wassnameandPI[gpt-5.6-terra] 19fea686c7 Smoke corrected WVS provider policy
Co-Authored-By: PI[gpt-5.6-terra] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 19:20:51 +08:00
wassnameandPI[gpt-5.6-terra] 02eb587fc2 Filter specialized models from WVS lanes
Co-Authored-By: PI[gpt-5.6-terra] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 19:20:19 +08:00
wassnameandPI[gpt-5.6-terra] 4bfef7fb3c Account for discarded WVS experiment spend
Co-Authored-By: PI[gpt-5.6-terra] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 19:18:25 +08:00
wassnameandPI[gpt-5.6-terra] aeadc751c6 Queue canonical WVS score-all-options refresh
Co-Authored-By: PI[gpt-5.6-terra] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 19:16:14 +08:00
wassnameandPI[gpt-5.6-terra] 4de1938d5f Remove discarded pick-one-option WVS experiment
Co-Authored-By: PI[gpt-5.6-terra] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 19:06:22 +08:00
wassnameandPI[gpt-5.6-terra] 912451eaeb Prevent WVS frontier label placement crashes
Co-Authored-By: PI[gpt-5.6-terra] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 17:01:09 +08:00
wassnameandPI[gpt-5.6-terra] 08139484c0 Publish WVS capability selector
Co-Authored-By: PI[gpt-5.6-terra] <288921227+claudypoo@users.noreply.github.com>
2026-09-17 16:56:04 +08:00