🤗 pets

Parameter-Efficient Tuning at Scale with 🤗 Accelerate

Supported moethods:

1. Prefix Tuning
2. P-Tuning
3. Prompt Tuning
4. LoRA [in progress]

Models support matrix

Sequence Classification

	Prefix Tuning	P-Tuning	Prompt Tuning	LoRA
RoBERTa	✅	✅	✅
BERT	✅	✅	✅
Deberta-v2
BloomX
Bloom
mT-0
T-0
T5
GPT-2
BART