wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-06-28 23:59:11 +08:00
Code Issues Packages Projects Releases Wiki Activity
822 Commits 1 Branch 0 Tags
76e8a70476ef9daa970349c14c117fe91e8b4544
Commit Graph

3 Commits

Author SHA1 Message Date
Sage Moore ce4f5a29fb Add Automatic Prefix Caching (#2762) 
Co-authored-by: ElizaWszola <eliza@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
 2024-03-02 00:50:01 -08:00
Suhong Moon 3ec8c25cd0 [Docs] Update documentation for gpu-memory-utilization option (#2162) 2023-12-17 10:51:57 -08:00
Casper a921d8be9d [DOCS] Add engine args documentation (#1741) 2023-11-22 12:31:27 -08:00