wassname/lora-lite
1
0
Fork 0
mirror of https://github.com/wassname/lora-lite.git synced 2026-06-27 16:45:56 +08:00
Code Issues Packages Projects Releases Wiki Activity

comment hygiene + HRA row: shorten docstrings, drop dead init branch, track asvd

Browse Source 
- variant.py: fix mislabeled "legacy entry" (make() is the live param path); drop unused near_one init branch
- config.py: drop "replaces older LoraLiteConfig" history narration
- antipasto_ablate.py: aspirational "should warm-start" comment -> tracked FIXME
- antipasto_rot.py: cut "kept as separate variant" / "why antipasto dropped rotation" ramble
- benchmark: merge duplicate antipasto/corda/asvd cfg branch
- README: fill HRA row (test 59.2 / valid 70.0)
- track antipasto_asvd.py (was imported+registered but uncommitted)

Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>
This commit is contained in:
wassname
2026-06-17 11:16:07 +08:00
parent 5f9d90d8b8
commit 7e024b4734
7 changed files with 56 additions and 25 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+2 -2
View File
@@ -56,8 +56,8 @@ use r=32; the AntiPaSTO family uses r=256 (it tunes only S-space gain, so it nee
| [LoRA](https://arxiv.org/abs/2106.09685) | 59.8 | 68.0 | 3.54M | 3.54M | 173 / 573 | 0.02 |
| [PiSSA](https://arxiv.org/abs/2404.02948) | 59.8 | 76.0 | 3.54M | 3.54M | 146 / 549 | 2.04 |
| [DoRA](https://arxiv.org/abs/2402.09353) | 60.2 | 68.0 | 3.56M | 3.54M | 161 / 556 | 0.16 |
| [DeLoRA](https://arxiv.org/abs/2503.18225) | — | — | — | — | — | — |
| [HRA](https://arxiv.org/abs/2405.17484) | — | — | — | — | — | — |
| [DeLoRA](https://arxiv.org/abs/2503.18225) | 56.2 | 62.0 | 3.54M | 3.54M | 169 / 593 | 0.21 |
| [HRA](https://arxiv.org/abs/2405.17484) | 59.2 | 70.0 | 2.75M | 2.75M | 225 / 948 | 0.04 |
| [EVA](https://arxiv.org/abs/2410.07170) | — | — | — | — | — | — |
| [IA3](https://arxiv.org/pdf/2205.05638) | — | — | — | — | — | — |
| [IA3-FF](https://arxiv.org/pdf/2205.05638) | — | — | — | — | — | — |