wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-07-19 11:29:39 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,628 Commits 1 Branch 0 Tags
40bc242579d260e6da7614e1494cbd80a6f985b2
Commit Graph
3 Commits
Author SHA1 Message Date
youkaichaoGitHubNick Hill
 		e893795443 [2/N] executor pass the complete config to worker/modelrunner (#9938) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
 2024-11-02 07:35:05 -07:00
Joe RundeandGitHub 380e18639f 🐛 fix torch memory profiling (#9516) 
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
 2024-10-18 21:25:19 -04:00
Joe RundeandGitHub de4008e2ab [Bugfix][Core] Use torch.cuda.memory_stats() to profile peak memory usage (#9352) 
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
 2024-10-17 22:47:27 -04:00