wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-07 11:30:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,965 Commits 1 Branch 0 Tags
82c49d3260f1fb9fcd686736e8439dc69cd2f1c4
Commit Graph
4 Commits
Author SHA1 Message Date
sasha0552andGitHub 337ed76671 [Bugfix] Fix offline mode when using mistral_common (#9457) 2024-10-18 18:12:32 -07:00
Cody YuandGitHub d11bf435a0 [MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510) 2024-10-18 14:30:55 -07:00
Joe RundeandGitHub de4008e2ab [Bugfix][Core] Use torch.cuda.memory_stats() to profile peak memory usage (#9352) 
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
 2024-10-17 22:47:27 -04:00
Joe RundeandGitHub f2e263b801 [Bugfix] Offline mode fix (#8376) 
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
 2024-09-12 11:11:57 -07:00