wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-01 03:26:53 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,272 Commits 1 Branch 0 Tags
021b1a2ab7497769dae8a67ea3467e4bafb474c5
Commit Graph

4 Commits

Author SHA1 Message Date
Lily Liu 43c413ec57 [Kernel] Use flashinfer for decoding (#4353) 
Co-authored-by: LiuXiaoxuanPKU <llilyliupku@gmail.com>
 2024-05-03 15:51:27 -07:00
SangBin Cho 67b4221a61 [Core][5/N] Fully working chunked prefill e2e (#3884) 2024-04-10 17:56:48 -07:00
youkaichao 8f44facddd [Core] remove cupy dependency (#3625) 2024-03-27 00:33:26 -07:00
Zhuohan Li a61f0521b8 [Test] Add basic correctness test (#2908) 2024-02-18 16:44:50 -08:00