lewtunandGitHub a9b8a50a27 🌟 (#135) ...

* Add StarChat2

* Add DPO

* Fix unit test

* Typos

* Typo

2024-03-12 17:22:21 +01:00

..

accelerate_configs

Add doc

2023-11-09 07:32:24 +00:00

constitutional-ai

Constitutional AI recipe (#108)

2024-02-01 07:02:19 -08:00

pref_align_scan

DPO/IPO/KTO ablations (#104)

2024-01-18 14:55:00 +01:00

starchat2-15b

🌟 (#135)

2024-03-12 17:22:21 +01:00

zephyr-7b-beta

Apply quantization during DPO QLoRA (#115)

2024-02-05 16:50:17 +01:00

zephyr-7b-gemma

🌟 (#135)

2024-03-12 17:22:21 +01:00

launch.slurm

Update Zephyr configs to account for UltraFeedback & TRL fixes (#88)

2024-01-10 17:42:24 +11:00