wassname/peft
1
0
Fork 0
mirror of https://github.com/wassname/peft.git synced 2026-09-26 14:00:37 +08:00
Code Issues Packages Projects Releases Wiki Activity
273 Commits 1 Branch 0 Tags
2632e7eba7fd06da522483caa1e676922258aaa9
Commit Graph
273 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Younes Belkada 2632e7eba7 [CI] Add ci tests (#203) 
* add ci tests

* fix some tests

* fix tests

* rename

* fix

* update tests

* try

* temp hotfix

* refactor tests

* Update .github/workflows/tests.yml

* fix test
 2023-03-23 12:38:40 +01:00
Sourab Mangrulkar 13e53fc7ee Merge pull request #180 from mymusise/chatglm 
ChatGLM support
 2023-03-20 15:02:58 +05:30
mymusise 54b6ce2c0e ChatGLM support 
Signed-off-by: mymusise <mymusise1@gmail.com>
 2023-03-16 19:09:12 +08:00
Sourab Mangrulkar 64f63a7df2 Merge pull request #167 from dumpmemory/update-readme-patch-for-zero-init 
Update README.md
 2023-03-15 22:33:42 +05:30
Younes Belkada df0e1fb592 [core] Fix peft multi-gpu issue (#145) 
* add multi-gpu support

* rm deepcopy

* tryo to comment

* style

* fix nits
 2023-03-14 13:06:33 +01:00
Sourab Mangrulkar 1c11bc067f Merge pull request #160 from zphang/llama 
Support for LLaMA models
 2023-03-14 11:18:29 +05:30
Sourab Mangrulkar 3b3fc47f84 Merge pull request #170 from PanQiWei/temporarily_replace_prepare_inputs_for_generation 
Replace base_model's function temporarily
 2023-03-14 11:05:01 +05:30
Sourab Mangrulkar 321cbd6829 Merge pull request #172 from huggingface/smangrul/fix-megred-linear-lora-issues 
fixing merged_linear lora issues
 2023-03-14 10:56:44 +05:30
Sourab Mangrulkar 43cb7040c6 fixing merged_linear lora issues 2023-03-13 16:01:28 +05:30
PanQiWei 644d68ee6f changed: 1. replace base_model.prepare_inputs_for_generation and base_model._prepare_encoder_decoder_kwargs_for_generation temporarily 2023-03-10 10:36:11 +08:00
dumpmemory 354bea8719 Update README.md 2023-03-09 22:03:40 +08:00
dumpmemory e85c18f019 Update README.md 
add one caveat situation for using LoRA + ZeRO 3 setting.
 2023-03-09 22:01:16 +08:00
Sourab Mangrulkar 50aaf99da7 Merge pull request #166 from huggingface/smangrul/release-v0.3.0.dev0 
release v0.3.0.dev0
 2023-03-09 09:24:05 +05:30
Sourab Mangrulkar 80c96de277 release v0.3.0.dev0 2023-03-09 09:23:24 +05:30
Sourab Mangrulkar eb07373477 Merge pull request #165 from huggingface/smangrul/add-trl-example-in-readme 
minor changes
 2023-03-09 08:58:09 +05:30
Sourab Mangrulkar f1980e9be2 minor changes 2023-03-09 08:57:52 +05:30
Sourab Mangrulkar 8777b5606d Merge pull request #164 from huggingface/smangrul/add-trl-example-in-readme 
Update README.md
 2023-03-09 08:53:56 +05:30
Sourab Mangrulkar 4497d6438c Update README.md 2023-03-09 08:53:36 +05:30
Sourab Mangrulkar 3d898adb26 Merge pull request #157 from huggingface/smangrul/lora_fixes_and_updates_wrt_trl 
lora fixes and adding 8bitMegredLinear lora
 2023-03-08 23:06:25 +05:30
Sourab Mangrulkar 842b09a280 Merge pull request #159 from zphang/prefix_citation 
Add Prefix Tuning citation
 2023-03-08 23:05:17 +05:30
Sourab Mangrulkar 91c69a80ab Merge pull request #162 from dumpmemory/fix_count 
fix count
 2023-03-08 23:03:58 +05:30
Sourab Mangrulkar c1199931de Merge pull request #163 from alvanli/alvanli/add-local-saving-whisper-largev2 
Add local saving for whisper largev2 example notebook
 2023-03-08 23:02:36 +05:30
alvanli 5e788b329d Use on save callback 2023-03-08 10:05:53 -05:00
alvanli 48dc4c624e Add callback to save to local 2023-03-08 09:57:13 -05:00
dumpmemory d2b99c0b62 fix count 
num_params should be directly used.
 2023-03-08 18:41:30 +08:00
Jason Phang baa2a4d53f LLaMA support 2023-03-07 21:05:58 -05:00
Jason Phang 27c2701555 Add Prefix Tuning citation 2023-03-07 19:17:35 -05:00
Sourab Mangrulkar a43ef6ec72 fixing ds conv1D issue thanks to @dumpmemory 2023-03-08 00:53:08 +05:30
Sourab Mangrulkar c81b6680e7 adding 8bitMegredLinear lora 2023-03-07 17:59:02 +05:30
Sourab Mangrulkar 8358b27445 Merge pull request #149 from huggingface/smangrul/fixes 
minor fixes to the examples
 2023-03-07 14:08:25 +05:30
Sourab Mangrulkar b9451ab458 fixing issues and quality ✨ 2023-03-07 14:04:19 +05:30
Sourab Mangrulkar ce4e6f3dd9 Merge pull request #150 from mayank31398/mayank/single-module 
support option for encoder only prompts
 2023-03-04 09:03:26 +05:30
mayank31398 53eb209387 support option for encoder only prompts 2023-03-03 23:43:25 +05:30
Sourab Mangrulkar a84414f6de minor fixes to the examples 2023-03-03 19:36:13 +05:30
Sourab Mangrulkar 2c532713ad Merge pull request #125 from SauravMaheshkar/minimal-structure 
chore: update `pyproject.toml`
 2023-03-02 19:07:59 +05:30
Saurav Maheshkar 94f00b7d27 chore: update Makefile with ruff commands 2023-02-28 10:46:07 +00:00
Saurav MaheshkarandSourab Mangrulkar 7820a539dd fix(pyproject.toml): update known_first_party 
Co-authored-by: Sourab Mangrulkar <13534540+pacman100@users.noreply.github.com>
 2023-02-28 16:10:38 +05:30
Saurav Maheshkar 47601bab7c chore: drop setup.cfg as we shifted to ruff 2023-02-28 02:58:12 +05:30
Saurav Maheshkar 99901896cc style: switch to ruff 2023-02-27 10:50:10 +00:00
Saurav Maheshkar 5c7fe97753 Merge branch 'huggingface:main' into minimal-structure 2023-02-27 10:37:41 +00:00
Sourab Mangrulkar aa18556c56 Merge pull request #140 from zanussbaum/zero_init 
fix: count params when zero init'd
 2023-02-27 13:18:30 +05:30
zanussbaum e6bf09db80 fix: count params when zero init'd 2023-02-26 22:31:20 -05:00
Sourab Mangrulkar 681ce93cc1 Merge pull request #134 from gabinguo/main 
issue#126: torch.load device issue.
 2023-02-25 11:43:43 +05:30
Kunpeng GUO 85ad682530 issue#126: torch.load device issue. 2023-02-25 07:09:07 +01:00
Sourab Mangrulkar e19ee681ac Merge pull request #127 from huggingface/smangrul/make-activation-checkpointing-optional 
fixes `prepare_for_int8_training`
 2023-02-25 02:13:04 +05:30
Sourab Mangrulkar 83d6d55d4b address layernorm issue 2023-02-24 18:24:27 +05:30
Sourab Mangrulkar 7dfb472424 make gradient checkpointing optional when using PEFT+INT8 2023-02-24 13:02:40 +05:30
Saurav Maheshkar a78f8a0495 style: move isort and pytest config to pyproject 2023-02-23 11:34:18 +00:00
Saurav Maheshkar 6175ee2c4c chore: drop MANIFEST 2023-02-23 11:30:14 +00:00
Younes Belkada a3537160dc fix autocast issue (#121) 2023-02-23 09:17:40 +01:00