wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-12 12:30:29 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,259 Commits 1 Branch 0 Tags
07ab160741a486bbef23efbf26aaf2ea8a785ae1
Commit Graph
5 Commits
Author SHA1 Message Date
Lucas WilkinsonandGitHub a8d604ca2a [Misc] Disambiguate quantized types via a new ScalarType (#6396) 2024-08-02 13:51:58 -07:00
bnellnmandGitHub 5467ac3196 [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) 2024-06-09 16:23:30 -04:00
Divakar VermaandGitHub a66cf40b20 [Kernel][ROCm][AMD] enable fused topk_softmax kernel for moe layer (#4927) 
This PR enables the fused topk_softmax kernel used in moe layer for HIP
 2024-06-02 14:13:26 -07:00
Michael GoinandGitHub 5f6d10c14c [CI/Build] Enforce style for C++ and CUDA code with clang-format (#4722) 2024-05-22 07:18:41 +00:00
Woosuk KwonandGitHub f0d4e14557 Add fused top-K softmax kernel for MoE (#2769) 2024-02-05 17:38:02 -08:00