wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-19 11:29:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,090 Commits 1 Branch 0 Tags
23b899a8e62c7ea07981bf8487b0dc2cb17847b8
Commit Graph
4 Commits
Author SHA1 Message Date
Cody YuandGitHub d11bf435a0 [MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510) 2024-10-18 14:30:55 -07:00
Cyrus LeungandGitHub 9ba85bc152 [mypy] Misc. typing improvements (#7417) 2024-08-13 09:20:20 +08:00
Sanger SteelandGitHub 052b6f8ca4 [Bugfix] Fix tensorizer memory profiling bug during testing (#6881) 2024-07-30 11:48:50 -07:00
Sanger SteelandGitHub 969d032265 [Bugfix]: Fix Tensorizer test failures (#6835) 2024-07-26 20:02:25 -07:00