wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-02 13:10:42 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,282 Commits 1 Branch 0 Tags
e97f802b2d74861af77997691a7d1c36498f6dca
Commit Graph
2 Commits
Author SHA1 Message Date
Cody YuandGitHub d11bf435a0 [MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510) 2024-10-18 14:30:55 -07:00
Zhuohan LiGitHubrsnm2Robert Shaw
 		1102bef219 [Bugfix / Core] Prefix Caching Guards (merged with main) (#4846) 
Co-authored-by: rsnm2 <rshaw@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
 2024-05-27 15:18:17 -07:00