mirror of
https://github.com/wassname/lora-lite.git
synced 2026-06-27 18:05:16 +08:00
wassname
7eeaeed206
- Test all 6 variants against bnb.Linear8bitLt + Linear4bit in smoke - bnb-friendly (LoRA, IA3, HRA, DeLoRA): identity err <= 2.4e-4 - bnb-incompatible (PiSSA, DoRA): fail-loud TypeError as expected - HRA: rewrite to paper-faithful input-side reflections (h <- (I-2vv^T)h), fixing previous broken output-side formulation - IA3: bypass dtype upcast for bnb (params stay fp16/quantized) - DeLoRA: explicit type check rejecting non-nn.Linear (incl. bnb) - adapter: special-case bnb param assignment via .data - Re-verified Qwen0.6B HRA probe: drop=20.7%, id_err=0, reload=0
19 lines
163 B
Plaintext
19 lines
163 B
Plaintext
.venv
|
|
.env
|
|
__pycache__/
|
|
*.pyc
|
|
*.pyo
|
|
*.pyd
|
|
*.db
|
|
*.sqlite3
|
|
*.log
|
|
*.bak
|
|
build/
|
|
dist/
|
|
*.egg-info/
|
|
logs/
|
|
outputs/
|
|
tests/_artifacts/
|
|
docs/papers/*.pdf
|
|
docs/papers/*.txt
|