wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-25 13:30:54 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,479 Commits 1 Branch 0 Tags
fee4dcc33ad3fb3988bfdf89aceef04c462ae1ce
Commit Graph
4 Commits
Author SHA1 Message Date
Varun Sundar RabindranathGitHubVarun Sundar RabindranathRobert Shaw
 		f081c3ce4b [Kernel] Update Cutlass fp8 configs (#5144) 
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
 2024-06-01 08:46:07 +00:00
Tyler Michael SmithandGitHub 260d119e86 [Kernel] Refactor CUTLASS kernels to always take scales that reside on the GPU (#5137) 2024-06-01 06:45:32 +00:00
Tyler Michael SmithandGitHub 8674f9880e [Kernel] Fixup for CUTLASS kernels in CUDA graphs (#4954) 
Pass the CUDA stream into the CUTLASS GEMMs, to avoid future issues with CUDA graphs
 2024-05-22 14:10:43 +00:00
Tyler Michael SmithandGitHub 2060e93659 [Kernel] Add w8a8 CUTLASS kernels (#4749) 2024-05-16 18:32:50 -04:00