wassname/alignment-handbook
1
0
Fork 0
mirror of https://github.com/wassname/alignment-handbook.git synced 2026-06-27 18:22:17 +08:00
Code Issues Packages Projects Releases Wiki Activity

Change 'three' to 'four' in README (#202)

Browse Source
This commit is contained in:
Mikhail Poludin
2024-11-19 11:00:16 +01:00
committed by GitHub
parent 7d711cd80d
commit e057d7f45b
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
scripts/README.md
+1 -1
View File
@@ -2,7 +2,7 @@
## Fine-tuning
In the handbook, we provide three main ways to align LLMs for chat:
In the handbook, we provide four main ways to align LLMs for chat:
- Full fine-tuning on a multi-GPU machine with DeepSpeed ZeRO-3 (tested on an 8 x A100 (80GB) node).
- LoRA or QLoRA fine-tuning on a single consumer 24GB GPU (tested on an RTX 4090).