Commit Graph

31 Commits

Author SHA1 Message Date
Edward Oakes 0306e4d589 [serve] Refer to serve "instances," not "clusters" (#8746) 2020-06-02 15:16:29 -07:00
Edward Oakes 2e82e05e4b [serve] Add list_backends and list_endpoints (#8737) 2020-06-02 15:14:10 -07:00
Edward Oakes e91f095d98 [Serve] Remove ray_init_kwargs in serve.init (#8747) 2020-06-02 14:05:35 -07:00
Edward Oakes 57bf0e43f0 fix docstring (#8736) 2020-06-02 08:55:20 -07:00
krfricke e5b6566d28 Remove blocking flag from serve.init() (#8654) 2020-05-29 13:25:35 -07:00
Edward Oakes 137519e19d [serve] Remove start_server flag (#8620) 2020-05-26 14:34:18 -05:00
Edward Oakes 860eb6f13a Update named actor API (#8559) 2020-05-24 20:08:03 -05:00
Edward Oakes fb23bd6fc0 [serve] Optionally namespace serve clusters (#8447) 2020-05-17 00:14:42 -05:00
Edward Oakes ef498e8aa5 [serve] Add basic session affinity via shard key (#8449) 2020-05-15 16:18:52 -05:00
Edward Oakes ef20564d8e [serve] Pin http proxy to the node that serve.init() is run on (#8436) 2020-05-14 16:38:29 -05:00
Max Fitton 00325eb2b2 Rename max_reconstructions to max_restarts and use -1 for infinite (#8274)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-05-14 10:30:29 -05:00
Simon Mo c5a5a5de89 [Serve] Refactor Metric System: Counter + Measure Support (#8114) 2020-05-06 17:44:02 -07:00
Edward Oakes 13f718846d [serve] Always use internal KV store (#8270) 2020-05-01 14:18:18 -05:00
Edward Oakes 6373c70661 [serve] Refactor BackendConfig (#8202) 2020-04-30 22:31:07 -05:00
Edward Oakes 95d187e556 [serve] Add delete_endpoint call (#8256) 2020-04-30 20:59:07 -05:00
Edward Oakes 43be73e4cf [serve] Add delete_backend call (#8252) 2020-04-30 13:10:39 -05:00
Edward Oakes 7c0200c93b [serve] Master actor fault tolerance (#8116) 2020-04-28 15:52:29 -05:00
Edward Oakes 505f3a8714 [serve] Remove serve.link(), rename serve.split() -> serve.set_traffic() (#8072) 2020-04-21 14:26:07 -05:00
Edward Oakes 213d3894ca Remove serve.route decorator (#8108) 2020-04-20 16:22:25 -05:00
Edward Oakes 7be7af11ab [serve] Push requests to workers instead of polling via dequeue_request (#7965) 2020-04-10 14:47:03 -05:00
Edward Oakes d8f5b52265 [serve] Don't use mixin class for class-based backends (#7957) 2020-04-10 12:01:14 -05:00
Edward Oakes 85481d635d [serve] Call serve.init() before initializing backends (#7922) 2020-04-07 17:22:52 -05:00
Edward Oakes 1be87c7fbb [serve] Remove global state, instead access the master actor directly (#7914)
* Move _scale() to master actor

* move create_backend

* Move set_backend_config

* Move get_backend_config

* Remove backend_table from global_state

* Remove global_state, just access master directly

* Remove accidental addition
2020-04-07 15:21:40 -05:00
Edward Oakes d3c310f408 [serve] Only access backend_table in master actor (#7913) 2020-04-07 10:12:39 -05:00
Edward Oakes 7f9ddfcfd8 Only access route_table and policy_table in master actor (#7835) 2020-04-02 14:44:53 -07:00
Edward Oakes f4239d27fa [serve] Create all other actors in master actor (#7791) 2020-04-01 10:15:04 -05:00
Edward Oakes 3a53ea60d9 [Serve] Push route table updates to HTTP proxy (#7774) 2020-03-30 09:53:05 -07:00
Simon Mo 353d7e107f [Serve] Improve Serialization (#7688) 2020-03-29 14:57:19 -07:00
Simon Mo a519b4f2a9 [Serve] Enhancement in HTTP Methods and Multi-route support (#7709) 2020-03-24 20:25:05 -07:00
Simon Mo ce0885a897 [Serve] UI Improvements (#7569) 2020-03-16 22:23:16 -07:00
Eric Liang 5df801605e Add ray.util package and move libraries from experimental (#7100) 2020-02-18 13:43:19 -08:00