# 🤗 pets
Parameter-Efficient Tuning at Scale with 🤗 Accelerate

Supported moethods:
1. Prefix Tuning
2. P-Tuning
3. Prompt Tuning
4. LoRA [in progress]

## Models support matrix

### Sequence Classification
|            | Prefix Tuning | P-Tuning  | Prompt Tuning | LoRA  | 
| --------- | ---- | ---- | ---- | ---- | 
| RoBERTa        | ✅  | ✅  | ✅  |   | 
| BERT           | ✅  | ✅  | ✅  |   |  
| Deberta-v2     |   |   |   |   |
| BloomX         |   |   |   |   | 
| Bloom          |   |   |   |   | 
| mT-0           |   |   |   |   | 
| T-0            |   |   |   |   | 
| T5             |   |   |   |   | 
| GPT-2          |   |   |   |   | 
| BART           |   |   |   |   |