wassname/vllm
1
0 Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-10-03 13:02:20 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,369 Commits 1 Branch 0 Tags
cabaf4eff3c7df30d785769d5a0a1fa1a1c48a8a
Commit Graph
4 Commits
Author SHA1 Message Date
sasha0552 337ed76671 [Bugfix] Fix offline mode when using mistral_common (#9457) 2024-10-18 18:12:32 -07:00
Cody Yu d11bf435a0 [MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510) 2024-10-18 14:30:55 -07:00
Joe Runde de4008e2ab [Bugfix][Core] Use torch.cuda.memory_stats() to profile peak memory usage (#9352) 
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
 2024-10-17 22:47:27 -04:00
Joe Runde f2e263b801 [Bugfix] Offline mode fix (#8376) 
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
 2024-09-12 11:11:57 -07:00