wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-31 12:50:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,103 Commits 1 Branch 0 Tags
c9f09a4fe83ef13824ea1663214ac7aad08d2b31
Commit Graph
2 Commits
Author SHA1 Message Date
Cody YuandGitHub d11bf435a0 [MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510) 2024-10-18 14:30:55 -07:00
Zhuohan LiGitHubrsnm2Robert Shaw
 		1102bef219 [Bugfix / Core] Prefix Caching Guards (merged with main) (#4846) 
Co-authored-by: rsnm2 <rshaw@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
 2024-05-27 15:18:17 -07:00