436 Commits
Author SHA1 Message Date
wassname ed4651de18 Merge remote-tracking branch 'upstream/main'
I hope this merge was right...
2023-04-10 16:09:19 +08:00
wassname 48b7b43fc4 fixes 2023-04-10 14:48:26 +08:00
wassname d5514e6c11 Update autograd_4bit.py 2023-04-10 14:45:21 +08:00
wassname 3c7417d485 Create matmul_utils_4bit 2023-04-10 14:45:02 +08:00
wassname 7a97f01e63 Update lora.py 2023-04-10 14:43:29 +08:00
wassname 4343563173 copy autograd_4bit from johnsmith
from https://raw.githubusercontent.com/johnsmith0031/alpaca_lora_4bit/main/autograd_4bit.py
2023-04-10 14:20:10 +08:00
John Smith 085c09d826 fix bug 2023-04-09 12:40:39 +08:00
John Smith 117fbfc94f fix version number 2023-04-09 12:30:52 +08:00
John Smith de6e390d6a add g_idx support 2023-04-09 12:29:45 +08:00
Sourab Mangrulkar 1117d47721 Merge pull request #283 from huggingface/smangrul/multi-lora-support
fix trainable params setting
2023-04-08 13:57:08 +05:30
Sourab Mangrulkar f982d75fa0 Merge pull request #261 from younesbelkada/fix-half-prec
Fix half precision forward
2023-04-08 13:56:36 +05:30
Sourab Mangrulkar fdebf8ac4f Merge pull request #256 from younesbelkada/add-gpu-tests
[`tests`] Adds GPU tests
2023-04-08 13:56:18 +05:30
Sourab Mangrulkar ff282c2a8f Update peft_model.py 2023-04-08 11:45:32 +05:30
Sourab Mangrulkar 7b7038273a fix trainable params issue 2023-04-08 11:32:00 +05:30
Robert Milletichandrmilleti 0422df466e Fix typo in examples/causal_language_modeling/peft_lora_clm_accelerate_ds_zero3_offload.py (#275) (#277)
Co-authored-by: rmilleti <rmilleti@amazon.com>
2023-04-07 17:49:35 +02:00
younesbelkada f35b20a845 add and fix tests 2023-04-07 10:48:22 +00:00
younesbelkada c22a57420c Merge remote-tracking branch 'upstream/main' into fix-half-prec 2023-04-07 10:36:58 +00:00
younesbelkada 04689b6535 make style 2023-04-07 10:35:39 +00:00
Younes Belkada bd1b4b5aa9 Merge branch 'main' into add-gpu-tests 2023-04-07 12:34:16 +02:00
Sourab Mangrulkar 445940fb7b Merge pull request #263 from huggingface/smangrul/multi-lora-support
Multi Adapter support
2023-04-07 04:40:59 +05:30
Sourab Mangrulkar e8b0085d2b fixing adalora saving and loading 2023-04-07 04:08:10 +05:30
Sourab Mangrulkar d5feb8b787 fixing 🐛 2023-04-06 21:17:54 +05:30
Sourab Mangrulkar 3258b709a3 fix 🐛 2023-04-06 20:41:36 +05:30
Sourab Mangrulkar a591b4b905 final fix I guess 2023-04-06 20:04:04 +05:30
Sourab Mangrulkar 3aaf482704 fix 2023-04-06 20:02:31 +05:30
Sourab Mangrulkar 07a4b8aacc fix 🐛 2023-04-06 19:56:55 +05:30
Sourab Mangrulkar b6c751455e 😅 2023-04-06 19:31:21 +05:30
Sourab Mangrulkar dee2a96fea Update adalora.py 2023-04-06 19:22:56 +05:30
Sourab Mangrulkar b728f5f559 🐛 fixing 2023-04-06 19:20:13 +05:30
Sourab Mangrulkar 74e2a3da50 😅 2023-04-06 19:16:37 +05:30
Sourab Mangrulkar 1a6151b91f Merge branch 'main' into smangrul/multi-lora-support 2023-04-06 19:10:48 +05:30
Sourab Mangrulkar 7397160435 making adalora compatible with multiple adapters 2023-04-06 19:06:33 +05:30
Sourab Mangrulkar 75808eb2a6 Merge branch 'main' into smangrul/multi-lora-support 2023-04-06 19:05:31 +05:30
Sourab Mangrulkar 382b178911 Merge pull request #260 from younesbelkada/add-pix2struct
Add BLIP2 Example
2023-04-06 11:45:55 +05:30
Sourab Mangrulkar a7d5e518c3 Merge pull request #233 from QingruZhang/main
The Implementation of AdaLoRA (ICLR 2023)
2023-04-06 11:30:30 +05:30
Qingru Zhang 072da6d9d6 Run make style and make quality 2023-04-05 20:52:12 +00:00
zqingru 4f8c134102 raise exception for MergedLinear of AdaLoRA 2023-04-05 20:40:06 +00:00
Qingru ZhangandSourab Mangrulkar b8a57a3649 Update src/peft/tuners/adalora.py
Co-authored-by: Sourab Mangrulkar <13534540+pacman100@users.noreply.github.com>
2023-04-05 16:32:23 -04:00
Qingru ZhangandSourab Mangrulkar d892beb0e7 Update src/peft/mapping.py
Co-authored-by: Sourab Mangrulkar <13534540+pacman100@users.noreply.github.com>
2023-04-05 16:31:58 -04:00
Qingru ZhangandSourab Mangrulkar 9a534d047c Update src/peft/tuners/adalora.py
Co-authored-by: Sourab Mangrulkar <13534540+pacman100@users.noreply.github.com>
2023-04-05 16:31:46 -04:00
Qingru ZhangandSourab Mangrulkar c240a9693c Update src/peft/tuners/adalora.py
Co-authored-by: Sourab Mangrulkar <13534540+pacman100@users.noreply.github.com>
2023-04-05 16:31:08 -04:00
Qingru ZhangandSourab Mangrulkar b3e6ef6224 Update src/peft/tuners/adalora.py
Co-authored-by: Sourab Mangrulkar <13534540+pacman100@users.noreply.github.com>
2023-04-05 16:30:16 -04:00
Qingru ZhangandSourab Mangrulkar 3e6a88a8f9 Update src/peft/tuners/adalora.py
Co-authored-by: Sourab Mangrulkar <13534540+pacman100@users.noreply.github.com>
2023-04-05 16:23:48 -04:00
younesbelkada 37e1f9ba34 fix test 2023-04-05 17:17:01 +00:00
Sourab Mangrulkar d936aa9349 fix tests 2023-04-05 19:54:02 +05:30
Sourab Mangrulkar 7888f699f5 Merge branch 'main' into smangrul/multi-lora-support 2023-04-05 14:09:01 +05:30
Younes Belkada deff03f2c2 [tests] Adds more tests + fix failing tests (#238)
* adds more tests

- refactor tests
- add enc-dec tests
- skips generate tests for non-lora adapters

* rm unneeded file

* fix tests

* fix

* more checks

* fix issue
2023-04-05 10:17:26 +02:00
Sourab Mangrulkar 405f68f54a fix doc failure 2023-04-05 12:40:02 +05:30
Sourab Mangrulkar 44f3e86b62 Update config.py 2023-04-05 03:35:08 +05:30
Sourab Mangrulkar 75131959d1 fix 🐛 2023-04-05 02:03:31 +05:30