lora-lite/.gitignore at 7eeaeed206dea1bfbee124cdec1ecdaafb6cf6ef - lora-lite - Gitea: Git with a cup of tea

wassname/lora-lite

mirror of https://github.com/wassname/lora-lite.git synced 2026-06-27 19:31:26 +08:00

Files

T

wassname 7eeaeed206 Verify all variants on bnb 4bit/8bit; HRA paper-faithful rewrite

- Test all 6 variants against bnb.Linear8bitLt + Linear4bit in smoke
- bnb-friendly (LoRA, IA3, HRA, DeLoRA): identity err <= 2.4e-4
- bnb-incompatible (PiSSA, DoRA): fail-loud TypeError as expected
- HRA: rewrite to paper-faithful input-side reflections (h <- (I-2vv^T)h),
  fixing previous broken output-side formulation
- IA3: bypass dtype upcast for bnb (params stay fp16/quantized)
- DeLoRA: explicit type check rejecting non-nn.Linear (incl. bnb)
- adapter: special-case bnb param assignment via .data
- Re-verified Qwen0.6B HRA probe: drop=20.7%, id_err=0, reload=0

2026-04-26 18:08:06 +08:00

19 lines

163 B

Plaintext

Raw Blame History

 .venv
 .env
 __pycache__/
 *.pyc
 *.pyo
 *.pyd
 *.db
 *.sqlite3
 *.log
 *.bak
 build/
 dist/
 *.egg-info/
 logs/
 outputs/
 tests/_artifacts/
 docs/papers/*.pdf
 docs/papers/*.txt