wassname/alpaca_convert
1
0
Fork 0
mirror of https://github.com/wassname/alpaca_convert.git synced 2026-07-19 11:20:53 +08:00
Code Issues Packages Projects Releases Wiki Activity
36 Commits 2 Branches 0 Tags
cd1a299ba34b4de002f1237e0b4b09e6b00a5eda
Commit Graph
5 Commits
Author SHA1 Message Date
John SmithandGitHub 4906961bf1 fix bug 2023-03-23 23:37:39 +08:00
ForkozandGitHub 58998acc9f Fix cuda kernel for Pascal & Cuda 6/6.1 
When I left the other functions to use normal atomic add it seemed like a small speedup. 4.79 it/s vs 5.23 it/s
 2023-03-23 07:33:57 -05:00
John Smith 3471be4e56 add fast_4bit_matmul and auto switch 2 methods according to bottleneck 2023-03-21 08:43:07 +00:00
John Smith 5b64833390 add half support on cuda kernel 2023-03-20 09:19:05 +00:00
John SmithandGitHub 551f62a0e8 add patch for gptq and peft 2023-03-18 13:31:48 +08:00