From 44dcd63aaa09ad0b5848c1a6c41f630eb9784ce7 Mon Sep 17 00:00:00 2001 From: Yu Meng Date: Thu, 18 Jul 2024 15:51:06 -0400 Subject: [PATCH] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 5e5a8c5..278dd6f 100644 --- a/README.md +++ b/README.md @@ -61,7 +61,7 @@ Our released Llama3 models use the initial version of the Llama3 tokenizer (prio *Notably, if you are training Llama3 and evaluating the trained models on AlpacaEval 2 and Arena-Hard using the templates provided in this repo, please make sure to use the pre-update Llama3 tokenizer (i.e., the one before the PR).* ### Reproducing AlpacaEval 2 numbers -Please make sure that you use `AlpacaEval==0.6.2` for successfully reproducing AlpacaEval 2 results. +Please make sure that you use `alpaca-eval==0.6.2` for successfully reproducing AlpacaEval 2 results. ### Adding an extra SFT loss The [CPO_SIMPO](https://github.com/fe1ixxu/CPO_SIMPO/tree/main) repository did preliminary experiments and observed that in some cases, adding an additional SFT loss can help improve results. In our own experiments, the SFT regularization helps preserve the reasoning ability (e.g., GSM8K) but degrades chat performance. If you'd like to apply SFT regularization, you can set `sft_weight` to be a positive value (by default it's 0).