mirror of
https://github.com/wassname/ray.git
synced 2026-10-04 13:00:39 +08:00
[Serve] Add ServeHandle metrics (#13640)
This commit is contained in:
1 parent
4bc257f4fb
commit
cb771f263d
5 files changed
+64
-16
No files matched your search
@@ -321,6 +321,10 @@ The following metrics are exposed by Ray Serve:
|
||||
- The number of HTTP requests processed.
|
||||
* - ``serve_num_router_requests``
|
||||
- The number of requests processed by the router.
|
||||
* - ``serve_handle_request_counter``
|
||||
- The number of requests processed by this ServeHandle.
|
||||
* - ``backend_queued_queries``
|
||||
- The number of queries for this backend waiting to be assigned to a replica.
|
||||
|
||||
To see this in action, run ``ray start --head --metrics-export-port=8080`` in your terminal, and then run the following script:
|
||||
|
||||
|
||||
Reference in new issue
Block a user