Edward Oakes 527b0380c9 [serve] Add microbenchmark script (#8887)

2020-06-10 21:28:52 -05:00

..

benchmarks

[serve] Add microbenchmark script (#8887)

2020-06-10 21:28:52 -05:00

examples

[serve] Add microbenchmark script (#8887)

2020-06-10 21:28:52 -05:00

metric

[serve] Replace actor error retry logic with max_task_retries (#8768)

2020-06-05 10:45:28 -05:00

tests

Fix Serve Flaky test_api::test_batching (#8867)

2020-06-09 16:49:17 -07:00

__init__.py

[serve] Add list_backends and list_endpoints (#8737)

2020-06-02 15:14:10 -07:00

api.py

[Serve] Batching in Worker Replica (#8709)

2020-06-09 11:29:16 -07:00

backend_worker.py

[serve] Fix worker batch queue waiting logic (#8884)

2020-06-10 21:28:16 -05:00

BUILD

[Serve] Batching in Worker Replica (#8709)

2020-06-09 11:29:16 -07:00

config.py

[serve] Fix worker batch queue waiting logic (#8884)

2020-06-10 21:28:16 -05:00

constants.py

Remove blocking flag from serve.init() (#8654)

2020-05-29 13:25:35 -07:00

context.py

Add ray.util package and move libraries from experimental (#7100)

2020-02-18 13:43:19 -08:00

exceptions.py

[serve] Refactor BackendConfig (#8202)

2020-04-30 22:31:07 -05:00

handle.py

[serve] Add basic session affinity via shard key (#8449)

2020-05-15 16:18:52 -05:00

http_proxy.py

[serve] Replace actor error retry logic with max_task_retries (#8768)

2020-06-05 10:45:28 -05:00

http_util.py

[Serve] Enhancement in HTTP Methods and Multi-route support (#7709)

2020-03-24 20:25:05 -07:00

kv_store.py

[serve] Always use internal KV store (#8270)

2020-05-01 14:18:18 -05:00

master.py

[Serve] Batching in Worker Replica (#8709)

2020-06-09 11:29:16 -07:00

policy.py

[Serve] Cleanup Router Implementation (#8718)

2020-06-01 19:21:28 -07:00

request_params.py

[serve] Add basic session affinity via shard key (#8449)

2020-05-15 16:18:52 -05:00

router.py

[Serve] Batching in Worker Replica (#8709)

2020-06-09 11:29:16 -07:00

utils.py

[Serve] Batching in Worker Replica (#8709)

2020-06-09 11:29:16 -07:00