Commit Graph

8 Commits

Author SHA1 Message Date
mrcabbage972 67aeed2cd7 Adding override of 32-bit optimization for embedding layer 2023-01-09 23:03:29 -05:00
mrcabbage972 08bdadf222 Adding BNB 8-bit Adam 2023-01-09 22:07:06 -05:00
Sotirios Anagnostidis d3952354e2 pre commits 2023-01-06 22:09:24 +01:00
Sotirios Anagnostidis 88ee3b3264 merge deepspeed 2023-01-06 21:28:26 +01:00
Sotirios Anagnostidis ef02693ac9 quantization 2023-01-06 18:24:28 +01:00
Sotirios Anagnostidis dfaa00dccc gptj 8bit 2023-01-05 00:33:16 +01:00
Sotirios Anagnostidis 3a10e9412d Question-Answer special tokens 2023-01-03 22:02:32 +01:00
Sotirios Anagnostidis 675b0866b0 SFT training 2023-01-03 01:31:56 +01:00