wassname/alignment-handbook
1
0
Fork 0
mirror of https://github.com/wassname/alignment-handbook.git synced 2026-06-27 16:14:07 +08:00
Code Issues Packages Projects Releases Wiki Activity

Add warmup to config (#71)

Browse Source 
Co-authored-by: lewtun <lewis.c.tunstall@gmail.com>
This commit is contained in:
Evgenii Zheltonozhskii
2024-01-04 07:04:46 +02:00
committed by GitHub
parent 57508b5c2d
commit e316174e1c
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
recipes/zephyr-7b-beta/sft/config_lora.yaml
+2 -1
View File
@@ -49,4 +49,5 @@ report_to:
- tensorboard
save_strategy: "no"
save_total_limit: null
seed: 42
seed: 42
warmup_ratio: 0.1