mirror of
https://github.com/wassname/evil_MoE.git
synced 2026-08-16 11:20:40 +08:00
docs: update method descriptions for activation routing
This commit is contained in:
@@ -1,4 +1,8 @@
|
||||
# v_hack extraction: gradient-space SVD with magnitudes
|
||||
# Historical: v_hack extraction in gradient space
|
||||
|
||||
This document describes the retired gradient-scored method. The current routeA
|
||||
method extracts `v_act` from pooled bottleneck activations with forward passes;
|
||||
see `README.md` and `src/vgrout/extract_vhack_act.py`.
|
||||
|
||||
Living design doc for the v_hack pipeline. Sibling to `RESEARCH_JOURNAL.md`.
|
||||
This explains *what we extract* and *why*.
|
||||
|
||||
Reference in New Issue
Block a user