This commit is contained in:
wassname
2026-04-25 19:27:53 +08:00
parent 977c054586
commit f0bce8be90
53 changed files with 950 additions and 4845 deletions
+12
View File
@@ -0,0 +1,12 @@
"""Weight-space diff: w = θ+ - θ-.
Functional replacement for the original TaskVector class.
Approach: load the +/- adapters, merge each into a delta state-dict over the
base model (delta = merged - base), then subtract:
w_layer = delta_pos[layer] - delta_neg[layer]
Merging into delta-W space (rather than diffing in adapter A/B space) makes
all adapter families comparable downstream - LoRA, DoRA, PiSSA-init, DeLoRA
all produce a delta in W's space.
"""