Edward Oakes 9ef48b16b6 [serve] Pull out goal management logic into AsyncGoalManager class (#13341)

2021-01-13 18:35:25 -06:00

..

benchmarks

Fix Serve release test (#13385)

2021-01-13 15:06:23 -08:00

examples

[Serve] Add dependency management support for driver not running in a conda env (#13269)

2021-01-12 09:57:15 -08:00

tests

[serve] Pull out goal management logic into AsyncGoalManager class (#13341)

2021-01-13 18:35:25 -06:00

__init__.py

[Serve] HTTPOptions for deployment modes (#13142)

2021-01-05 16:41:52 -08:00

api.py

[serve] Cleanup backend state, move checkpointing and async goal logic inside (#13298)

2021-01-11 11:45:43 -06:00

async_goal_manager.py

[serve] Pull out goal management logic into AsyncGoalManager class (#13341)

2021-01-13 18:35:25 -06:00

autoscaling_policy.py

[serve] Add min and max limits to autoscaling (#9955)

2020-08-07 15:30:14 -05:00

backend_state.py

[serve] Pull out goal management logic into AsyncGoalManager class (#13341)

2021-01-13 18:35:25 -06:00

backend_worker.py

[Serve] Support Starlette streaming response (#13328)

2021-01-11 13:27:44 -08:00

backends.py

[serve] Support for imported backends (#12923)

2020-12-18 15:49:24 -06:00

BUILD

[Serve] HTTPOptions for deployment modes (#13142)

2021-01-05 16:41:52 -08:00

common.py

[serve] Move controller state into separate files (#13204)

2021-01-05 14:37:16 -06:00

config.py

[Serve] HTTPOptions for deployment modes (#13142)

2021-01-05 16:41:52 -08:00

constants.py

[serve] Long polling for routes in http server (#12724)

2020-12-10 18:02:02 -06:00

controller.py

[serve] Pull out goal management logic into AsyncGoalManager class (#13341)

2021-01-13 18:35:25 -06:00

endpoint_policy.py

[serve] Long polling for routes in http server (#12724)

2020-12-10 18:02:02 -06:00

endpoint_state.py

[serve] Clean up EndpointState interface, move checkpointing inside of EndpointState (#13215)

2021-01-08 22:36:19 -06:00

env.py

[Serve] Add dependency management (#11743)

2020-11-05 16:39:37 -06:00

exceptions.py

[serve] Refactor BackendConfig (#8202)

2020-04-30 22:31:07 -05:00

handle.py

[Serve] Use ServeHandle in HTTP proxy (#12523)

2020-12-28 18:33:42 -08:00

http_proxy.py

[Serve] Support Starlette streaming response (#13328)

2021-01-11 13:27:44 -08:00

http_state.py

[serve] Clean up EndpointState interface, move checkpointing inside of EndpointState (#13215)

2021-01-08 22:36:19 -06:00

http_util.py

[Serve] Migrate from Flask.Request to Starlette Request (#12852)

2020-12-21 15:34:15 -06:00

kv_store.py

[serve] Add serve.shutdown() (#8766)

2020-06-23 13:42:03 -05:00

long_poll.py

[serve] Long polling for routes in http server (#12724)

2020-12-10 18:02:02 -06:00

router.py

[Serve] Use a small object to track requests (#13125)

2020-12-31 11:43:03 -08:00

scripts.py

[Serve] HTTPOptions for deployment modes (#13142)

2021-01-05 16:41:52 -08:00

utils.py

[Serve] Add dependency management support for driver not running in a conda env (#13269)

2021-01-12 09:57:15 -08:00