alignment-handbook

wassname/alignment-handbook

Fork 0

mirror of https://github.com/wassname/alignment-handbook.git synced 2026-07-21 12:20:50 +08:00

Files

T

History

595023faa4 Adding continued_pretraining task (#131 )

* add continued pretraining script

* simplify config; add dataset_config option

* add ds configs in data mixer creator

* use extended sftconfig

* add option to avoid setting chat template

* fix data_configs bug

* add continued pretraining info

* add gpt2-nl recipe for continued pretraining example

* add final newline

* make style

* Update README.md

Co-authored-by: lewtun <lewis.c.tunstall@gmail.com>

* Update README.md

Co-authored-by: lewtun <lewis.c.tunstall@gmail.com>

* Update recipes/gpt2-nl/README.md

Co-authored-by: lewtun <lewis.c.tunstall@gmail.com>

* rename continued pretraining to cpt

* improve README

---------

Co-authored-by: lewtun <lewis.c.tunstall@gmail.com>

2024-03-14 15:15:23 +01:00

accelerate_configs

Add doc

2023-11-09 07:32:24 +00:00

constitutional-ai

Constitutional AI recipe (#108 )

2024-02-01 07:02:19 -08:00

gpt2-nl

Adding continued_pretraining task (#131 )

2024-03-14 15:15:23 +01:00

pref_align_scan

DPO/IPO/KTO ablations (#104 )