 lewtun
|
f0ffa0d7a6
|
Update Zephyr configs to account for UltraFeedback & TRL fixes (#88)
* Add files
* Add checkpointing
* Add checkpointing to SFT
* Add loss type
* Fix setup|
* Clean SFT
* Add lora config
* Rename config
* Remove max eval samples
* Add kwargs tp push to hub
* Add DPO configs
* Fix dpo configs
* Extend chat template test to multi-turn
* Add warmup
* Refactor
* Fix LoRA -> QLoRA
* Fix configs
* Specify chat template
* Add sample logging
* Fix push to hub hanging
* Add reentrant
* Fix quality
* Add transformer logging
* Tweak grad acc
* Add null type
* Add doc
|
2024-01-10 17:42:24 +11:00 |
|
|
Kirill
|
98fe28fb14
|
Clean deprecated max_samples arguments (#89)
|
2024-01-05 09:06:47 +11:00 |
|
|
NielsRogge
|
57508b5c2d
|
Make SFT script consistent with DPO script (#86)
* Add argument
* Make scripts consistent
* Fix style
---------
Co-authored-by: lewtun <lewis.c.tunstall@gmail.com>
|
2024-01-04 15:55:58 +11:00 |
|
|
Nathan Azrak
|
3f368a0748
|
Add check that parameters are not intended to be offloaded (#51)
* Add check that parameters are not intended to be offloaded
* Only push model to device if quantization config is set.
|
2023-12-04 09:10:41 +01:00 |
|
|
Lewis Tunstall
|
33a0ce3afd
|
Add more doc
|
2023-11-09 13:39:03 +00:00 |
|
|
Lewis Tunstall
|
e54e095978
|
Make it work for realz
|
2023-11-08 22:20:17 +00:00 |
|
|
Lewis Tunstall
|
d2900adc83
|
Make it work!
|
2023-11-08 16:31:57 +00:00 |
|
|
Lewis Tunstall
|
967eab4cfb
|
Add skeleton
|
2023-11-08 13:21:57 +00:00 |
|