wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-07 11:30:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,490 Commits 1 Branch 0 Tags
fdd9daafa3b31746ec8ec7c0d67ebc7efeb13f8f
Commit Graph
4 Commits
Author SHA1 Message Date
Pavani MajetyGitHubSimon Mo
 		b98cc28f91 [Core][Kernels] Use FlashInfer backend for FP8 KV Cache when available. (#7798) 
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2024-08-28 10:01:22 -07:00
LI MOUandGitHub 53328d7536 [BUG] fix crash on flashinfer backend with cudagraph disabled, when attention group_size not in [1,2,4,8] (#7509) 2024-08-21 08:54:31 -07:00
jon-chuangandGitHub 50b8d08dbd [Misc/Testing] Use torch.testing.assert_close (#7324) 2024-08-16 04:24:04 +00:00
Lily LiuGitHubSimon Mo
 		69ec3ca14c [Kernel][Model] logits_soft_cap for Gemma2 with flashinfer (#6051) 
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2024-07-04 16:35:51 -07:00