mirror of
https://github.com/wassname/peft.git
synced 2026-09-25 13:50:20 +08:00
25 lines
702 B
Markdown
25 lines
702 B
Markdown
# 🤗 pets
|
|
Parameter-Efficient Tuning at Scale with 🤗 Accelerate
|
|
|
|
Supported moethods:
|
|
1. Prefix Tuning
|
|
2. P-Tuning
|
|
3. Prompt Tuning
|
|
4. LoRA [in progress]
|
|
|
|
## Models support matrix
|
|
|
|
### Sequence Classification
|
|
| | Prefix Tuning | P-Tuning | Prompt Tuning | LoRA |
|
|
| --------- | ---- | ---- | ---- | ---- |
|
|
| RoBERTa | ✅ | ✅ | ✅ | |
|
|
| BERT | ✅ | ✅ | ✅ | |
|
|
| Deberta-v2 | | | | |
|
|
| BloomX | | | | |
|
|
| Bloom | | | | |
|
|
| mT-0 | | | | |
|
|
| T-0 | | | | |
|
|
| T5 | | | | |
|
|
| GPT-2 | | | | |
|
|
| BART | | | | |
|