Edward Beeching cbcb3f60fb DPO/IPO/KTO ablations (#104) ...

* adds configs and readme

* cleaning config files

* fix typos and removes things from config

* updates text to use comparisons rather ablations

* fix readme and adds launch script

* fix launch script, adds blogpost link

* bump release version, added missing dep, fixes configs

* updates main readme file

2024-01-18 14:55:00 +01:00

..

accelerate_configs

Add doc

2023-11-09 07:32:24 +00:00

pref_align_scan

DPO/IPO/KTO ablations (#104)

2024-01-18 14:55:00 +01:00

zephyr-7b-beta

Update Zephyr configs to account for UltraFeedback & TRL fixes (#88)

2024-01-10 17:42:24 +11:00

launch.slurm

Update Zephyr configs to account for UltraFeedback & TRL fixes (#88)

2024-01-10 17:42:24 +11:00