wassname/jsteer
1
0
Fork 0
mirror of https://github.com/wassname/jsteer.git synced 2026-09-09 11:25:03 +08:00
Code Issues Packages Projects Releases Wiki Activity

U4 step3: dim_batch 16->8 to survive OOM contention with user's VS Code kernel

Browse Source 
Run 551 was OOM-killed at n_done=36: the user's VS Code Jupyter kernel
(jsteer venv, PID 3214401) co-loaded ~1.5GB VRAM + 1.9GB RAM while the fit
sat at the 22.4/24.6GB ceiling. Clean SIGKILL with no CUDA traceback = host
OOM killer, not a CUDA OOM. dim_batch=8 halves the fit's peak footprint;
it changes only the backward schedule, not the accumulated Jacobian, so U4
exactness is preserved. Resumes from checkpoint (n_done=36), lossless.

Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>
This commit is contained in:
wassname
2026-07-10 13:56:17 +08:00
co-authored by Claudypoo
parent beec9189da
commit ebb912452d
6 changed files with 8 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/evidence/parity_u1.txt
+24
View File
@@ -0,0 +1,24 @@
U1 parity: cached-Jacobian pullback vs direct VJP (word=happy/joy)
model=Qwen/Qwen3-0.6B prompts=8 layers=[8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24]
| layer | cos | |vA| | |vB| |
|--------:|----------:|----------:|----------:|
| 8 | +0.999801 | +1.000000 | +1.000000 |
| 9 | +0.999862 | +1.000000 | +1.000000 |
| 10 | +0.999899 | +1.000000 | +1.000000 |
| 11 | +0.999904 | +1.000000 | +1.000000 |
| 12 | +0.999923 | +1.000000 | +1.000000 |
| 13 | +0.999940 | +1.000000 | +1.000000 |
| 14 | +0.999953 | +1.000000 | +1.000000 |
| 15 | +0.999967 | +1.000000 | +1.000000 |
| 16 | +0.999976 | +1.000000 | +1.000000 |
| 17 | +0.999982 | +1.000000 | +1.000000 |
| 18 | +0.999985 | +1.000000 | +1.000000 |
| 19 | +0.999990 | +1.000000 | +1.000000 |
| 20 | +0.999992 | +1.000000 | +1.000000 |
| 21 | +0.999994 | +1.000000 | +1.000000 |
| 22 | +0.999996 | +1.000000 | +1.000000 |
| 23 | +0.999996 | +1.000000 | +1.000000 |
| 24 | +0.999996 | +1.000000 | +1.000000 |
min cos = +0.999801 GATE (>0.999): PASS
docs/evidence/u4_step2_vjp_parity.txt
+28
View File
@@ -0,0 +1,28 @@
U4 step 2: jsteer word_vector_vjp vs regenerated run-524 vector
model=Qwen/Qwen3-4B prompts=400 words=['authority', 'obey', 'command', 'hierarchy']
layer cos(jsteer_vjp, ref524)
------- -------------------------
7 +1.000000
8 +1.000000
9 +1.000000
10 +1.000000
11 +1.000000
12 +1.000000
13 +1.000000
14 +1.000000
15 +1.000000
16 +1.000000
17 +1.000000
18 +1.000000
19 +1.000000
20 +1.000000
21 +1.000000
22 +1.000000
23 +1.000000
24 +1.000000
25 +1.000000
26 +1.000000
27 +1.000000
min cos = +1.000000 GATE (>0.999): PASS