wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-08-11 11:24:51 +08:00
Code Issues Packages Projects Releases Wiki Activity

[serve] Rename to use replicas, not workers (#11822)

Browse Source
This commit is contained in:
Ian Rodney
2020-11-10 11:36:15 -08:00
committed by GitHub
parent 9b8218aabd
commit 1d158dda32
14 changed files with 172 additions and 170 deletions
Download Patch File Download Diff File Expand all files Collapse all files
doc/source/serve/tutorials/batch.rst
+1 -1
View File
@@ -63,7 +63,7 @@ are specifying the maximum batch size via ``config={"max_batch_size": 4}``. This
configuration option limits the maximum possible batch size sent to the backend.
.. note::
Ray Serve performs *opportunistic batching*. When a worker is free to evaluate
Ray Serve performs *opportunistic batching*. When a replica is free to evaluate
the next batch, Ray Serve will look at the pending queries and take
``max(number_of_pending_queries, max_batch_size)`` queries to form a batch.
You can provide :mod:`batch_wait_timeout <ray.serve.BackendConfig>` to override