wassname/evil_MoE
1
0
Fork 0
mirror of https://github.com/wassname/evil_MoE.git synced 2026-06-27 17:30:41 +08:00
Code Issues Packages Projects Releases Wiki Activity

misc

Browse Source
This commit is contained in:
wassname
2026-06-11 11:07:28 +00:00
parent 7871aa66b8
commit 270c4f5a27
30 changed files with 456 additions and 443 deletions
Download Patch File Download Diff File Expand all files Collapse all files
scripts/verify_lora2r_routing.py
+1 -1
View File
@@ -1,4 +1,4 @@
"""lora2r invariants (rank-2r Gaussian-init LoRA + SGTM-style block masks).
"""lora2r invariants (rank-2r Gaussian-init LoRA with per-rollout output masks).
Asserts, on tiny-random-qwen3 (CPU, fp32):
1. IDENTITY AT INIT: wrapped logits == base logits (the hook subtracts the