wassname/alignment-handbook
1
0
Fork 0
mirror of https://github.com/wassname/alignment-handbook.git synced 2026-06-27 17:14:25 +08:00
Code Issues Packages Projects Releases Wiki Activity

Fix links

Browse Source
This commit is contained in:
Lewis Tunstall
2023-11-09 14:42:57 +00:00
parent 89f58a043c
commit 4b0769d137
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
recipes/zephyr-7b/README.md
+2 -2
View File
@@ -3,8 +3,8 @@
As described in the Zephyr [technical report](https://huggingface.co/papers/2310.16944), training this model proceeds in two steps:
1. Apply SFT to fine-tune Mistral 7B on the UltraChat dataset.
2. Align the SFT model to AI feedback via DPO on the UltraFeedback dataset.
1. Apply SFT to fine-tune Mistral 7B on a filtered version of the UltraChat dataset ([link](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k)).
2. Align the SFT model to AI feedback via DPO on a preprocessed version of the UltraFeedback dataset ([link](https://huggingface.co/datasets/HuggingFaceH4/ultrafeedback_binarized)).
See below for commands to train these models using either DeepSpeed ZeRO-3 or LoRA.