Files
lora-lite/src/lora_lite
wassname f91c7b23f2 antipasto: add EVA-style data-driven group_init
Weight-SVD init (PiSSA-style) kept as fallback; when calibration_data is
provided, group_init() collects pre-hook activations, SVDs the pooled inputs
per layer, and re-decomposes W_orig through the top-r input-PCA directions.
Vhr_final = Vh_A @ Vhr_new keeps rows orthonormal while preserving the
input-aligned span.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-01 20:55:56 +08:00
..
2026-04-27 09:47:07 +08:00
2026-04-27 06:23:30 +08:00