Edward Beeching and GitHub
cbcb3f60fb
DPO/IPO/KTO ablations ( #104 )
...
* adds configs and readme
* cleaning config files
* fix typos and removes things from config
* updates text to use comparisons rather ablations
* fix readme and adds launch script
* fix launch script, adds blogpost link
* bump release version, added missing dep, fixes configs
* updates main readme file
2024-01-18 14:55:00 +01:00
lewtun and GitHub
f0ffa0d7a6
Update Zephyr configs to account for UltraFeedback & TRL fixes ( #88 )
...
* Add files
* Add checkpointing
* Add checkpointing to SFT
* Add loss type
* Fix setup|
* Clean SFT
* Add lora config
* Rename config
* Remove max eval samples
* Add kwargs tp push to hub
* Add DPO configs
* Fix dpo configs
* Extend chat template test to multi-turn
* Add warmup
* Refactor
* Fix LoRA -> QLoRA
* Fix configs
* Specify chat template
* Add sample logging
* Fix push to hub hanging
* Add reentrant
* Fix quality
* Add transformer logging
* Tweak grad acc
* Add null type
* Add doc
2024-01-10 17:42:24 +11:00
Girraj Jangid and GitHub
7d6fe765ec
Update README.md ( #35 )
...
update installation instruction. Added git cmd
2023-11-20 08:52:16 +01:00
Alvaro Bartolome and GitHub
0e09b0c6ec
Fix note syntax highlighting in README.md ( #20 )
2023-11-15 08:45:27 +01:00
lewtun and GitHub
a1afb2bbd4
Fix image alignment ( #19 )
2023-11-12 15:47:10 +01:00
lewtun and GitHub
4c6226bc42
Add moar explanations ( #18 )
2023-11-12 15:43:39 +01:00
Kashif Rasul and GitHub
4b0c1fe170
fix typos ( #17 )
2023-11-12 13:44:50 +01:00
363e29ff95
Apply suggestions from code review
...
Co-authored-by: Philipp Schmid <32632186+philschmid@users.noreply.github.com >
2023-11-10 15:49:00 +01:00
Lewis Tunstall
edf67d1d93
Tweaks
2023-11-10 11:15:45 +00:00
Lewis Tunstall
610a1a2de4
Add unit tests for data mixer
2023-11-10 08:37:53 +00:00
Lewis Tunstall
89f58a043c
Add project structure
2023-11-09 14:40:23 +00:00
Lewis Tunstall
33a0ce3afd
Add more doc
2023-11-09 13:39:03 +00:00
Lewis Tunstall
d2900adc83
Make it work!
2023-11-08 16:31:57 +00:00
lewtun and GitHub
3d8570af1e
Update README.md
2023-10-26 23:21:53 +02:00
Lewis Tunstall
3a8003c782
Fix Makefile
2023-10-26 09:30:24 +00:00
Stefano Fiorucci and GitHub
73c5c136c3
fix typos
2023-10-10 22:28:22 +02:00
Lewis Tunstall
8248414cf6
Rename repo
2023-10-09 19:12:47 +02:00
Lewis Tunstall
8197fe1b1e
Update readme
2023-10-09 16:46:56 +02:00
Nathan Lambert
c3fb784998
fixes
2023-08-29 16:30:18 -07:00
Lewis Tunstall
8903d4aff8
Add skeleton structure
2023-08-29 09:33:26 +02:00
lewtun and GitHub
1aa5a69b17
Initial commit
2023-08-25 13:35:35 +02:00
