Commit Graph
6 Commits
Author SHA1 Message Date
wassnameandClaudypoo 4c93aaddb5 U4 step3: dim_batch 8->4 + expandable_segments after 2nd OOM
552 CUDA-OOM'd at n_done=45: the user's VS Code GPU kernel grew to 8.18GB
while this fit's 13.23GB hit the 23.5GB ceiling (44MB free, fragmentation).
dim_batch=4 shrinks the fit to ~10.5GB (polite co-tenant, leaves user ~13GB)
and expandable_segments:True defragments (the OOM's own suggestion). Still
only changes the backward schedule, not the Jacobian. Resumes from n_done=45.

Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>
2026-07-10 14:10:39 +08:00
wassnameandClaudypoo ebb912452d U4 step3: dim_batch 16->8 to survive OOM contention with user's VS Code kernel
Run 551 was OOM-killed at n_done=36: the user's VS Code Jupyter kernel
(jsteer venv, PID 3214401) co-loaded ~1.5GB VRAM + 1.9GB RAM while the fit
sat at the 22.4/24.6GB ceiling. Clean SIGKILL with no CUDA traceback = host
OOM killer, not a CUDA OOM. dim_batch=8 halves the fit's peak footprint;
it changes only the backward schedule, not the accumulated Jacobian, so U4
exactness is preserved. Resumes from checkpoint (n_done=36), lossless.

Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>
2026-07-10 13:56:17 +08:00
wassnameandClaudypoo 2a05dbc799 U4 loop-close scripts: regenerate ref-524 vector, port check, 4B fit (pueue 549-551)
Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>
2026-07-10 13:13:50 +08:00
wassnameandClaudypoo e2a28a9c5d fit script: 64-prompt reproducible Qwen3-0.6B Jacobian cache
Hardcoded diverse web-text prompts (min 21 tokens), layers 0.3-0.9,
resumable checkpoint, saves artifacts/qwen3-0.6b.jac.

Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>
2026-07-10 13:03:18 +08:00
wassnameandClaudypoo f22bbeb0d2 parity(U1): cached-J pullback vs direct VJP, all layers cos>0.999
min cos 0.999801 (layer 8), rising to 0.999996; gap is fp16 cache
storage as expected. Gate PASS.

Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>
2026-07-10 12:52:18 +08:00
wassnameandClaudypoo 6bf51a75cc smoke: fit+steer Qwen3-0.6B on happy/joy end-to-end
+C collapses to "joy", -C to negative tone: sign correct. Coherence
breaks at |C|=8 uncalibrated, as expected.

Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>
2026-07-10 12:51:08 +08:00