Increase S-space top_k to 1024

This commit is contained in:
wassname
2026-04-10 09:52:24 +08:00
parent 382ffc4315
commit e44dc0e74e
2 changed files with 7 additions and 7 deletions
+1 -1
View File
@@ -39,7 +39,7 @@ NUM_EXAMPLES = 3
# %%
def get_s_space_projector(model, top_k=256):
def get_s_space_projector(model, top_k=1024):
"""
Gathers all weight matrices that write to the residual stream
(o_proj from attention and down_proj from MLP) across all layers,