 Younes Belkada
|
a3537160dc
|
fix autocast issue (#121)
|
2023-02-23 09:17:40 +01:00 |
|
|
Sourab Mangrulkar
|
75925b1aae
|
Merge pull request #117 from huggingface/smangrul/fix-lora-merging-in-inference
fix merging lora weights for inference
|
2023-02-22 00:20:40 +05:30 |
|
|
Sourab Mangrulkar
|
1ef0f89a0c
|
add util for getting the base model
|
2023-02-22 00:14:24 +05:30 |
|
|
Sourab Mangrulkar
|
e6ef85a711
|
fix merging lora weights for inference
|
2023-02-22 00:00:36 +05:30 |
|
|
Sourab Mangrulkar
|
6f2803e8a7
|
Merge pull request #109 from huggingface/smangrul/add-gpt-neox
add `EleutherAI/gpt-neox-20b` to support matrix
|
2023-02-18 12:38:04 +05:30 |
|
|
Sourab Mangrulkar
|
1c9d197693
|
add EleutherAI/gpt-neox-20b to support matrix
|
2023-02-18 12:37:02 +05:30 |
|
|
Sourab Mangrulkar
|
592b1dd99f
|
Merge pull request #106 from huggingface/smangrul/add-diable-adapter-context-manager
add disable adapter context manager
|
2023-02-17 20:32:31 +05:30 |
|
|
Sourab Mangrulkar
|
3240c0bb36
|
Merge pull request #107 from mrm8488/patch-1
Fix typo
|
2023-02-17 20:30:27 +05:30 |
|
|
Manuel Romero
|
e8fbcfcac3
|
Fix typo
|
2023-02-17 15:08:47 +01:00 |
|
|
Sourab Mangrulkar
|
1a8928c5a4
|
Update lora.py
|
2023-02-17 17:48:16 +05:30 |
|
|
Sourab Mangrulkar
|
173dc3dedf
|
add disable_adapter context manager
|
2023-02-17 17:40:45 +05:30 |
|
|
Younes Belkada
|
dbf44fe316
|
[core] Some changes with prepare_model_for_training & few fixes (#105)
* changes
* apply to other notebooks
|
2023-02-17 10:49:11 +01:00 |
|
|
Sourab Mangrulkar
|
648fcb397c
|
Merge pull request #104 from huggingface/smangrul/make_lora_target_modules_accept_regex
add support for regex target modules in lora
|
2023-02-17 15:00:58 +05:30 |
|
|
Sourab Mangrulkar
|
7aadb6d9ec
|
add support for regex target modules in lora
|
2023-02-17 14:52:03 +05:30 |
|
|
Sourab Mangrulkar
|
49842e1961
|
Merge pull request #97 from huggingface/smangrul/make-bnb-optional
making `bnb` optional
|
2023-02-16 22:33:51 +05:30 |
|
|
Sourab Mangrulkar
|
44d0ac3f25
|
fix
|
2023-02-16 20:15:48 +05:30 |
|
|
Sourab Mangrulkar
|
43a9a42991
|
fix
|
2023-02-16 20:11:39 +05:30 |
|
|
Sourab Mangrulkar
|
145b13c238
|
making bnb optional
|
2023-02-16 20:07:06 +05:30 |
|
|
Sourab Mangrulkar
|
8ace5532b2
|
Merge pull request #95 from huggingface/smangrul/add-whisper-example
adding whisper large peft+int8 training example
|
2023-02-16 17:43:46 +05:30 |
|
|
Sourab Mangrulkar
|
c1281b96ff
|
resolving comments and running jupyter black
|
2023-02-16 17:42:28 +05:30 |
|
|
Sourab Mangrulkar
|
ca7b46209a
|
adding whisper large peft+int8 training example
|
2023-02-16 15:06:42 +05:30 |
|
|
Sourab Mangrulkar
|
81285f30a5
|
Merge pull request #90 from huggingface/smangrul/fix-prepare-inputs-for-training
making `prepare_model_for_training` flexible
|
2023-02-16 11:38:35 +05:30 |
|
|
Sourab Mangrulkar
|
c9b225d257
|
revert
|
2023-02-15 16:58:33 +05:30 |
|
|
Sourab Mangrulkar
|
af7414a67d
|
fix forward signature
|
2023-02-15 15:44:26 +05:30 |
|
|
Sourab Mangrulkar
|
6d6149cf81
|
preventing other 1D layers to be casted in FP32
|
2023-02-15 14:03:47 +05:30 |
|
|
Younes Belkada
|
a31dfa3001
|
Merge pull request #86 from younesbelkada/add-flan-t5-int8
[`bnb`] add flan-t5 example
|
2023-02-15 09:02:24 +01:00 |
|
|
younesbelkada
|
afa7739131
|
update
|
2023-02-15 08:01:56 +00:00 |
|
|
Sourab Mangrulkar
|
f1ee1e4c0f
|
making prepare_model_for_training flexible
|
2023-02-15 12:51:23 +05:30 |
|
|
Sourab Mangrulkar
|
ed5a7bff6b
|
Merge pull request #85 from younesbelkada/int8-wrapper
[`core`] add `prepare_model_for_training`
|
2023-02-15 11:21:03 +05:30 |
|
|
younesbelkada
|
42a793e2f5
|
update
|
2023-02-14 16:45:37 +00:00 |
|
|
younesbelkada
|
eb8362bbe1
|
update
|
2023-02-14 16:44:18 +00:00 |
|
|
younesbelkada
|
5733ea9f64
|
add flan example
|
2023-02-14 13:50:22 +00:00 |
|
|
younesbelkada
|
36c7e3b441
|
apply suggestions
|
2023-02-14 11:50:55 +00:00 |
|
|
younesbelkada
|
0e80648010
|
add prepare_model_for_training
|
2023-02-14 11:12:37 +00:00 |
|
|
Sourab Mangrulkar
|
be0e79c271
|
Merge pull request #68 from mayank31398/mayank/fp32-prompt-tuning
convert prompt tuning vocab to fp32
|
2023-02-13 11:26:46 +05:30 |
|
|
Sourab Mangrulkar
|
5acd392880
|
Merge pull request #77 from huggingface/smangrul/update-readme
Update README.md
|
2023-02-13 11:16:20 +05:30 |
|
|
Sourab Mangrulkar
|
951119fcfa
|
Update README.md
|
2023-02-13 11:14:35 +05:30 |
|
|
mayank31398
|
29d608f481
|
Merge remote-tracking branch 'huggingface/main' into mayank/fp32-prompt-tuning
|
2023-02-13 11:13:18 +05:30 |
|
|
Sourab Mangrulkar
|
15de814bb4
|
Merge pull request #73 from Muhtasham/patch-1
Fixed typo in Readme
|
2023-02-13 10:56:32 +05:30 |
|
|
Muhtasham Oblokulov
|
a29a12701e
|
Fixed typo in Readme
Also added links to datasets and models, plus enhanced config render with yaml command
|
2023-02-11 21:58:18 +01:00 |
|
|
Sayak Paul
|
3bd50315a6
|
Merge pull request #72 from huggingface/sayakpaul-patch-1
Update README.md
|
2023-02-11 15:32:38 +05:30 |
|
|
Sayak Paul
|
45186ee04e
|
Update README.md
|
2023-02-11 15:02:53 +05:30 |
|
|
Sourab Mangrulkar
|
c8e215b989
|
Merge pull request #69 from huggingface/smangrul/release-v0.2.0dev0
release v0.2.0.dev0
|
2023-02-10 15:45:22 +05:30 |
|
|
Sourab Mangrulkar
|
d1735e098c
|
release v0.2.0.dev0
|
2023-02-10 15:43:06 +05:30 |
|
|
mayank31398
|
c53ea2c9f4
|
fp32
|
2023-02-10 09:39:02 +05:30 |
|
|
Sourab Mangrulkar
|
f8e737648a
|
Merge pull request #67 from huggingface/smangrul/fix-save-pretrained
make `save_pretrained` work in a way training could be resumed
|
2023-02-10 00:14:39 +05:30 |
|
|
Sourab Mangrulkar
|
b1af297707
|
make save_pretrained work in a way training could be resumed
|
2023-02-10 00:06:25 +05:30 |
|
|
Sourab Mangrulkar
|
85c7b98307
|
Merge pull request #66 from huggingface/smangrul/update-bibtex
update bibtex
|
2023-02-09 17:26:17 +05:30 |
|
|
Sourab Mangrulkar
|
e41152e5f1
|
update bibtex
|
2023-02-09 17:25:52 +05:30 |
|
|
Sourab Mangrulkar
|
9f19ce6729
|
Merge pull request #64 from kashif/patch-1
Fix typos in readme
|
2023-02-09 17:18:36 +05:30 |
|