wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-08 11:59:43 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,442 Commits 1 Branch 0 Tags
e9d3aa04f6e55e2bb540f0810da97ddd0deebb13
Commit Graph

2 Commits

Author SHA1 Message Date
Tyler Michael Smith 8674f9880e [Kernel] Fixup for CUTLASS kernels in CUDA graphs (#4954) 
Pass the CUDA stream into the CUTLASS GEMMs, to avoid future issues with CUDA graphs
 2024-05-22 14:10:43 +00:00
Tyler Michael Smith 2060e93659 [Kernel] Add w8a8 CUTLASS kernels (#4749) 2024-05-16 18:32:50 -04:00