wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-06-27 18:06:25 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Serve] Add ServeHandle metrics (#13640)

Browse Source
This commit is contained in:
architkulkarni
2021-01-28 12:40:47 -08:00
committed by GitHub
parent 4bc257f4fb
commit cb771f263d
5 changed files with 64 additions and 16 deletions
Download Patch File Download Diff File Expand all files Collapse all files
doc/source/serve/advanced.rst
+4
View File
@@ -321,6 +321,10 @@ The following metrics are exposed by Ray Serve:
- The number of HTTP requests processed.
* - ``serve_num_router_requests``
- The number of requests processed by the router.
* - ``serve_handle_request_counter``
- The number of requests processed by this ServeHandle.
* - ``backend_queued_queries``
- The number of queries for this backend waiting to be assigned to a replica.
To see this in action, run ``ray start --head --metrics-export-port=8080`` in your terminal, and then run the following script: