wassname/weight-steering
1
0
Fork 0
mirror of https://github.com/wassname/weight-steering.git synced 2026-06-27 19:50:02 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
df61cdc628a8b1bdb975377d0e7194a65c1237d7
weight-steering/RESEARCH_LOG.md
T
wassname c1c4d2f3cb nb
2026-04-26 11:03:38 +08:00

209 B
Raw Blame History

fork_plan.md

made notebook

Where does the LoRA's Δa live?

In a task-derived hidden subspace that is not the lm_head readout. Held-out energy ratios (mean over LoRA-active layers 8–27, rank-8 each):

Reference in New Issue View Git Blame Copy Permalink