Commit Graph
266 Commits
Author SHA1 Message Date
Sourab Mangrulkar 1c11bc067f Merge pull request #160 from zphang/llama
Support for LLaMA models
2023-03-14 11:18:29 +05:30
Sourab Mangrulkar 3b3fc47f84 Merge pull request #170 from PanQiWei/temporarily_replace_prepare_inputs_for_generation
Replace base_model's function temporarily
2023-03-14 11:05:01 +05:30
Sourab Mangrulkar 321cbd6829 Merge pull request #172 from huggingface/smangrul/fix-megred-linear-lora-issues
fixing merged_linear lora issues
2023-03-14 10:56:44 +05:30
Sourab Mangrulkar 43cb7040c6 fixing merged_linear lora issues 2023-03-13 16:01:28 +05:30
PanQiWei 644d68ee6f changed: 1. replace base_model.prepare_inputs_for_generation and base_model._prepare_encoder_decoder_kwargs_for_generation temporarily 2023-03-10 10:36:11 +08:00
Sourab Mangrulkar 50aaf99da7 Merge pull request #166 from huggingface/smangrul/release-v0.3.0.dev0
release v0.3.0.dev0
2023-03-09 09:24:05 +05:30
Sourab Mangrulkar 80c96de277 release v0.3.0.dev0 2023-03-09 09:23:24 +05:30
Sourab Mangrulkar eb07373477 Merge pull request #165 from huggingface/smangrul/add-trl-example-in-readme
minor changes
2023-03-09 08:58:09 +05:30
Sourab Mangrulkar f1980e9be2 minor changes 2023-03-09 08:57:52 +05:30
Sourab Mangrulkar 8777b5606d Merge pull request #164 from huggingface/smangrul/add-trl-example-in-readme
Update README.md
2023-03-09 08:53:56 +05:30
Sourab Mangrulkar 4497d6438c Update README.md 2023-03-09 08:53:36 +05:30
Sourab Mangrulkar 3d898adb26 Merge pull request #157 from huggingface/smangrul/lora_fixes_and_updates_wrt_trl
lora fixes and adding 8bitMegredLinear lora
2023-03-08 23:06:25 +05:30
Sourab Mangrulkar 842b09a280 Merge pull request #159 from zphang/prefix_citation
Add Prefix Tuning citation
2023-03-08 23:05:17 +05:30
Sourab Mangrulkar 91c69a80ab Merge pull request #162 from dumpmemory/fix_count
fix count
2023-03-08 23:03:58 +05:30
Sourab Mangrulkar c1199931de Merge pull request #163 from alvanli/alvanli/add-local-saving-whisper-largev2
Add local saving for whisper largev2 example notebook
2023-03-08 23:02:36 +05:30
alvanli 5e788b329d Use on save callback 2023-03-08 10:05:53 -05:00
alvanli 48dc4c624e Add callback to save to local 2023-03-08 09:57:13 -05:00
dumpmemory d2b99c0b62 fix count
num_params should be directly used.
2023-03-08 18:41:30 +08:00
Jason Phang baa2a4d53f LLaMA support 2023-03-07 21:05:58 -05:00
Jason Phang 27c2701555 Add Prefix Tuning citation 2023-03-07 19:17:35 -05:00
Sourab Mangrulkar a43ef6ec72 fixing ds conv1D issue thanks to @dumpmemory 2023-03-08 00:53:08 +05:30
Sourab Mangrulkar c81b6680e7 adding 8bitMegredLinear lora 2023-03-07 17:59:02 +05:30
Sourab Mangrulkar 8358b27445 Merge pull request #149 from huggingface/smangrul/fixes
minor fixes to the examples
2023-03-07 14:08:25 +05:30
Sourab Mangrulkar b9451ab458 fixing issues and quality ✨ 2023-03-07 14:04:19 +05:30
Sourab Mangrulkar ce4e6f3dd9 Merge pull request #150 from mayank31398/mayank/single-module
support option for encoder only prompts
2023-03-04 09:03:26 +05:30
mayank31398 53eb209387 support option for encoder only prompts 2023-03-03 23:43:25 +05:30
Sourab Mangrulkar a84414f6de minor fixes to the examples 2023-03-03 19:36:13 +05:30
Sourab Mangrulkar 2c532713ad Merge pull request #125 from SauravMaheshkar/minimal-structure
chore: update `pyproject.toml`
2023-03-02 19:07:59 +05:30
Saurav Maheshkar 94f00b7d27 chore: update Makefile with ruff commands 2023-02-28 10:46:07 +00:00
Saurav MaheshkarandSourab Mangrulkar 7820a539dd fix(pyproject.toml): update known_first_party
Co-authored-by: Sourab Mangrulkar <13534540+pacman100@users.noreply.github.com>
2023-02-28 16:10:38 +05:30
Saurav Maheshkar 47601bab7c chore: drop setup.cfg as we shifted to ruff 2023-02-28 02:58:12 +05:30
Saurav Maheshkar 99901896cc style: switch to ruff 2023-02-27 10:50:10 +00:00
Saurav Maheshkar 5c7fe97753 Merge branch 'huggingface:main' into minimal-structure 2023-02-27 10:37:41 +00:00
Sourab Mangrulkar aa18556c56 Merge pull request #140 from zanussbaum/zero_init
fix: count params when zero init'd
2023-02-27 13:18:30 +05:30
zanussbaum e6bf09db80 fix: count params when zero init'd 2023-02-26 22:31:20 -05:00
Sourab Mangrulkar 681ce93cc1 Merge pull request #134 from gabinguo/main
issue#126: torch.load device issue.
2023-02-25 11:43:43 +05:30
Kunpeng GUO 85ad682530 issue#126: torch.load device issue. 2023-02-25 07:09:07 +01:00
Sourab Mangrulkar e19ee681ac Merge pull request #127 from huggingface/smangrul/make-activation-checkpointing-optional
fixes `prepare_for_int8_training`
2023-02-25 02:13:04 +05:30
Sourab Mangrulkar 83d6d55d4b address layernorm issue 2023-02-24 18:24:27 +05:30
Sourab Mangrulkar 7dfb472424 make gradient checkpointing optional when using PEFT+INT8 2023-02-24 13:02:40 +05:30
Saurav Maheshkar a78f8a0495 style: move isort and pytest config to pyproject 2023-02-23 11:34:18 +00:00
Saurav Maheshkar 6175ee2c4c chore: drop MANIFEST 2023-02-23 11:30:14 +00:00
Younes Belkada a3537160dc fix autocast issue (#121) 2023-02-23 09:17:40 +01:00
Sourab Mangrulkar 75925b1aae Merge pull request #117 from huggingface/smangrul/fix-lora-merging-in-inference
fix merging lora weights for inference
2023-02-22 00:20:40 +05:30
Sourab Mangrulkar 1ef0f89a0c add util for getting the base model 2023-02-22 00:14:24 +05:30
Sourab Mangrulkar e6ef85a711 fix merging lora weights for inference 2023-02-22 00:00:36 +05:30
Sourab Mangrulkar 6f2803e8a7 Merge pull request #109 from huggingface/smangrul/add-gpt-neox
add `EleutherAI/gpt-neox-20b` to support matrix
2023-02-18 12:38:04 +05:30
Sourab Mangrulkar 1c9d197693 add EleutherAI/gpt-neox-20b to support matrix 2023-02-18 12:37:02 +05:30
Sourab Mangrulkar 592b1dd99f Merge pull request #106 from huggingface/smangrul/add-diable-adapter-context-manager
add disable adapter context manager
2023-02-17 20:32:31 +05:30
Sourab Mangrulkar 3240c0bb36 Merge pull request #107 from mrm8488/patch-1
Fix typo
2023-02-17 20:30:27 +05:30