wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-04 15:59:14 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,060 Commits 1 Branch 0 Tags
aba8d6ee006b78149ac4514f460e4038b2d4f607
Commit Graph

3 Commits

Author SHA1 Message Date
Cody Yu bf8717ebae [V1] Prefix caching for vision language models (#11187) 
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
 2024-12-17 16:37:59 -08:00
Ricky Xu d9b4b3f069 [Bug][CLI] Allow users to disable prefix caching explicitly (#10724) 
Signed-off-by: rickyx <rickyx@anyscale.com>
 2024-11-27 23:59:28 -08:00
Ricky Xu 519e8e4182 [v1] EngineArgs for better config handling for v1 (#10382) 
Signed-off-by: rickyx <rickyx@anyscale.com>
 2024-11-25 21:09:43 -08:00