wassname/lora-lite
1
0
Fork 0
mirror of https://github.com/wassname/lora-lite.git synced 2026-06-27 17:48:59 +08:00
Code Issues Packages Projects Releases Wiki Activity
Files
f91c7b23f2541d457ed753a08d168e5134be0745
lora-lite/src
T
History
wassname f91c7b23f2 antipasto: add EVA-style data-driven group_init 
Weight-SVD init (PiSSA-style) kept as fallback; when calibration_data is
provided, group_init() collects pre-hook activations, SVDs the pooled inputs
per layer, and re-decomposes W_orig through the top-r input-PCA directions.
Vhr_final = Vh_A @ Vhr_new keeps rows orthonormal while preserving the
input-aligned span.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-01 20:55:56 +08:00
..
lora_lite
antipasto: add EVA-style data-driven group_init
2026-05-01 20:55:56 +08:00