wassname/vllm
1
0
Fork 0
mirror of https://github.com/wassname/vllm.git synced 2026-08-17 11:28:47 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,445 Commits 1 Branch 0 Tags
8da48e4d95421cbd96fbdecdffed89a3d1aab218
Commit Graph
4 Commits
Author SHA1 Message Date
Mahesh Keralapura 93478b63d2 [Core] Fix tracking of model forward time in case of PP>1 (#7440) 
[Core] Fix tracking of model forward time to the span traces in case of PP>1 (#7440)
 2024-08-16 13:46:01 -07:00
Isotr0py 4c5d8e8ea9 [Bugfix] Fix phi3v batch inference when images have different aspect ratio (#7392) 2024-08-10 16:19:33 +00:00
Mahesh Keralapura 933790c209 [Core] Add span metrics for model_forward, scheduler and sampler time (#7089) 2024-08-09 13:55:13 -07:00
Ronen Schaffer 7879f24dcc [Misc] Add OpenTelemetry support (#4687) 
This PR adds basic support for OpenTelemetry distributed tracing.
It includes changes to enable tracing functionality and improve monitoring capabilities.

I've also added a markdown with print-screens to guide users how to use this feature. You can find it here
 2024-06-19 01:17:03 +09:00