wassname/peft
1
0
Fork 0
mirror of https://github.com/wassname/peft.git synced 2026-09-26 14:00:37 +08:00
Code Issues Packages Projects Releases Wiki Activity
149 Commits 1 Branch 0 Tags
ed0c962ff54e553c83dc0fbd46aec6f6674f1bba
Commit Graph
149 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Sourab Mangrulkar ed0c962ff5 fixes 2023-02-08 12:59:29 +05:30
Sourab Mangrulkar eec0b9329d Update peft_lora_clm_accelerate_ds_zero3_offload.py 2023-02-08 12:41:27 +05:30
Sourab Mangrulkar 1929a84e1e remove peft_model_load_and_dispatch as it is part of PeftModel.from_pretrained 2023-02-08 12:29:03 +05:30
Sourab Mangrulkar 522a6b6c17 add load_and_dispatch to load_pretrained 2023-02-08 12:18:03 +05:30
Sourab Mangrulkar 462b65fe45 fix lora_only 2023-02-08 10:26:56 +05:30
Sourab Mangrulkar b5c97f2039 Update save_and_load.py 2023-02-08 09:25:21 +05:30
Sourab Mangrulkar 64d2d19598 update peft_model_load_and_dispatch 2023-02-08 09:21:49 +05:30
Sourab Mangrulkar a7dd034710 fix prefix tuning config to remove function field as it cannot be converted to json 2023-02-08 08:49:15 +05:30
Sourab Mangrulkar bdeb3778d0 add support for generate when using prompt_tuning 2023-02-07 15:07:56 +05:30
Sourab Mangrulkar 5bc815e2e2 fix generate because of recent transformers release 2023-02-06 23:50:48 +05:30
Sourab Mangrulkar 5a43a3a321 seq cls examples update 2023-02-06 18:57:13 +05:30
Sourab Mangrulkar 7ae63299a8 Merge pull request #53 from younesbelkada/add-int8-example 
[ `example`] add bnb example
 2023-02-03 21:00:41 +05:30
younesbelkada 57de1d2677 add bnb example 2023-02-02 17:45:38 +01:00
Sourab Mangrulkar 383b5abb33 Merge pull request #51 from huggingface/smangrul/lora-raise-error-when-no-target-module-found 
for lora, raise error when no target modules in base model
 2023-02-02 13:35:47 +05:30
Sourab Mangrulkar d8ccd7d84c for lora, raise error when no target modules in base model 2023-02-02 13:29:49 +05:30
Sourab Mangrulkar df5b201c6b Merge pull request #50 from huggingface/smangrul/add-modules-to-save-to-lora-config 
add `modules_to_save` to LoraConfig and other fixes
 2023-02-02 13:19:37 +05:30
Sourab Mangrulkar 44d8e72ca8 fixes 2023-02-02 13:19:14 +05:30
Sourab Mangrulkar c37ee25be7 trying diff approaches 2023-02-01 19:35:19 +05:30
Sourab Mangrulkar c884daf96a getting rid to forward call linking 2023-02-01 19:18:38 +05:30
Sourab Mangrulkar fcd213708d fixes 2023-02-01 17:17:14 +05:30
Sourab Mangrulkar 915a5db0c6 fixes 2023-02-01 16:25:42 +05:30
Sourab Mangrulkar d53a631608 fixes 2023-02-01 15:59:24 +05:30
Sourab Mangrulkar b4d0885203 Merge pull request #49 from orenwang/main 
fix validation_steps handling in dreambooth example
 2023-02-01 15:42:35 +05:30
Sourab Mangrulkar d04f6661ee add modules_to_save to LoraConfig and other fixes 
1. Add `modules_to_save` to LoraConfig
2. Using PeftModel for LoraConfig instead of task-specific classes because LoRA is task agnostic.
 2023-02-01 15:41:35 +05:30
orenwang 80e1b262e5 fix validation_steps handling in dreambooth example 2023-01-31 10:59:46 +08:00
Sourab Mangrulkar dd518985ff Merge pull request #47 from orenwang/main 
allow validation images for lora training
 2023-01-30 16:13:28 +05:30
orenwang a17cea104e add validation images for lora training 2023-01-30 17:18:43 +08:00
Sourab Mangrulkar 3f9b310c6a Merge pull request #46 from huggingface/smangrul/fix-hf-hub-utils-tests 
fix hf hub util tests
 2023-01-30 13:35:06 +05:30
Sourab Mangrulkar 06e49c0a87 fixes 2023-01-30 13:31:01 +05:30
Sourab Mangrulkar 6cf2cf5dae fix hf hub util tests 2023-01-30 12:51:30 +05:30
Sourab Mangrulkar 3faaf0916a Merge pull request #39 from younesbelkada/add-push-to-hub 
[`core`] Add hub utils
 2023-01-30 12:34:13 +05:30
younesbelkada 6c9534e660 adapt for other models 2023-01-29 11:18:31 +00:00
younesbelkada 22295c4278 adapt from code review 
- remove `README`
- inherit from `dataclass`
- add new test
 2023-01-29 10:49:31 +00:00
Younes BelkadaandSourab Mangrulkar 16182ea972 Apply suggestions from code review 
Co-authored-by: Sourab Mangrulkar <13534540+pacman100@users.noreply.github.com>
 2023-01-29 11:41:38 +01:00
Younes Belkada ad69958e52 Merge branch 'main' into add-push-to-hub 2023-01-28 10:17:57 +01:00
Sourab Mangrulkar f8a2829318 Merge pull request #38 from huggingface/smangrul/fixes 
adding support for int8 lora training
 2023-01-27 19:20:12 +05:30
younesbelkada 634f3692d8 working v1 
- push to hub method works
- add tests
- add config super class
- add Lora support for `from_pretrained`
 2023-01-26 11:17:24 +00:00
younesbelkada 2cc7f2cbac add config tests 2023-01-26 10:12:51 +00:00
younesbelkada 2896cf05fb v1 working 
- from_pretrained support for config
- from_pretrained support for loramodel
- todo: tests
- todo: push_to_hub
 2023-01-25 22:43:22 +00:00
Sourab Mangrulkar 776a28f053 update lora to support int8 training 2023-01-25 12:27:02 +05:30
Sourab Mangrulkar d75746be70 adding support for int8 lora training 2023-01-25 04:19:23 +05:30
Sourab Mangrulkar 1dbe7fc0db Merge pull request #37 from huggingface/smangrul/fixes 
colab notebook example for lora peft application
 2023-01-24 21:20:06 +05:30
Sourab Mangrulkar ff8a5b9a69 colab notebook example for lora peft application 2023-01-24 21:19:47 +05:30
Sourab Mangrulkar 36267af51b Merge pull request #36 from huggingface/smangrul/fixes 
correcting requirements.txt in example sub-folders
 2023-01-22 11:21:01 +05:30
Sourab Mangrulkar fef162cff8 correcting requirements.txt in example sub-folders 2023-01-22 11:20:39 +05:30
Sourab Mangrulkar a8587916c8 Merge pull request #35 from huggingface/smangrul/fixes 
fixes and addressing comments from previous PR
 2023-01-21 18:31:28 +05:30
Sourab Mangrulkar 77670ead76 fixes and addressing comments from previous PR 
1. Minor updates/fixes in README.md and setup.py
2. Make `loralib` optional
 2023-01-21 18:17:19 +05:30
Sourab Mangrulkar 360fb2f816 Merge pull request #34 from huggingface/fix-typos 
Review & fix typos
 2023-01-21 18:00:12 +05:30
Lysandre a40f20ad6c Fix typos 2023-01-20 11:34:45 -05:00
Sourab Mangrulkar 407482eb37 Merge pull request #33 from huggingface/smangrul/fixes 
fixes, docs and version bump up
 2023-01-20 15:34:29 +05:30