Commit Graph

102 Commits

Author SHA1 Message Date
Simon Mo ed3fdd2c0b [Serve] Remove register_custom_serializer (#10331) 2020-08-25 21:20:43 -07:00
architkulkarni 07cd815e5a [Serve] Type hints for API (#10205) 2020-08-20 15:33:04 -07:00
Edward Oakes 888f0a2c60 [serve] Use ray.experimental.metrics (#10185) 2020-08-19 13:03:22 -05:00
Edward Oakes ba0f531da0 [serve] Remove SLO code and blist dependency (#10075) 2020-08-18 17:52:36 -05:00
architkulkarni fe5fcb6b9c [serve] backend and endpoint validation (#9954) 2020-08-13 11:56:50 -05:00
Edward Oakes ca37accc07 [serve] Add min and max limits to autoscaling (#9955) 2020-08-07 15:30:14 -05:00
Simon Mo c8da5555ab [Serve] Add preliminary middleware support (#9940) 2020-08-06 12:49:31 -07:00
Edward Oakes 38408574c4 [serve] Basic autoscaling policy (#9845) 2020-08-05 21:11:35 -05:00
Edward Oakes 55146d222f [serve] Detect node updates (#9828) 2020-08-04 15:57:21 -05:00
Robert Nishihara db0d6e8efa Make wait_for_condition raise exception when timing out. (#9710) 2020-07-26 22:56:32 -07:00
Simon Mo a078a21437 [Serve] Allow multiple HTTP servers. (#9523) 2020-07-24 12:41:20 -07:00
Simon Mo d8fd74d528 [Serve] Document Metric Infrastructure (#9389) 2020-07-21 14:52:18 -07:00
Ian Rodney b8fc259796 [serve] Rename to Controller (#9566) 2020-07-20 12:50:29 -07:00
Simon Mo d0398bf7e1 [Serve] Serialize Query object directly (#9490) 2020-07-20 10:10:07 -07:00
Simon Mo e78945db96 [Serve] Add internal instruction for running benchmarks (#9531) 2020-07-17 11:17:37 -07:00
Simon Mo 22a5c3d3ee Hotfix Lint for Serve (#9535) 2020-07-17 00:40:33 -07:00
Simon Mo 60a838f0f0 [Serve] Use pickle instead of clouldpickle (#9479) 2020-07-16 15:44:10 -07:00
Simon Mo 761b584814 [Serve] Improve buffering for simple cases (#9485) 2020-07-16 15:34:08 -07:00
Simon Mo d4a5d09dab [Serve] Merge router with HTTPProxy (#9225) 2020-07-10 13:52:48 -07:00
Hao Chen d49dadf891 Change Python's ObjectID to ObjectRef (#9353) 2020-07-10 17:49:04 +08:00
Sven Mika 4da0e542d5 [RLlib] DDPG and SAC eager support (preparation for tf2.x) (#9204) 2020-07-08 16:12:20 +02:00
Simon Mo a25472c657 [Serve] Fix prometheus exporter label override (#9227) 2020-07-02 11:40:14 -07:00
Simon Mo be647b69ab [Serve] Performance: Use uvloop when possible (#9216) 2020-06-30 15:59:13 -07:00
Edward Oakes 681bae709a [serve] Add backend config options to docstrings (#9193) 2020-06-30 10:53:17 -05:00
Edward Oakes 87e47c4a53 Fix serve dependencies (#9192) 2020-06-29 12:44:04 -05:00
mehrdadn 898e472425 Make test_utils.py use pipes to avoid file access conflicts on Windows (#9072)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-27 22:33:45 +02:00
Edward Oakes aa3fd62cac [serve] Add shadow traffic API (#9106) 2020-06-25 10:55:22 -05:00
Edward Oakes c9010eb8ad [serve] Add serve.shutdown() (#8766) 2020-06-23 13:42:03 -05:00
Simon Mo 2b5119218e [Serve] Raise exception when _scale_replicas is infeasible (#9005) 2020-06-21 15:38:58 -07:00
mehrdadn 981f67bfb0 Fix more Windows issues (#9011)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-19 18:51:45 -07:00
Simon Mo e89b8d37ae [Serve] Fix PyTorch Tutorial (#9019) 2020-06-18 15:41:43 -07:00
Edward Oakes 527b0380c9 [serve] Add microbenchmark script (#8887) 2020-06-10 21:28:52 -05:00
Edward Oakes 3a9f45c4b3 [serve] Fix worker batch queue waiting logic (#8884) 2020-06-10 21:28:16 -05:00
Simon Mo cf53b35147 [Serve] Add doc for model composition (#8871)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-06-10 11:09:22 -07:00
Simon Mo 7d52159d1a Fix Serve Flaky test_api::test_batching (#8867) 2020-06-09 16:49:17 -07:00
Simon Mo 6c3062906f [Serve] Batching in Worker Replica (#8709) 2020-06-09 11:29:16 -07:00
Edward Oakes 5d124489a9 [serve] Require backend when creating endpoint (#8764) 2020-06-06 21:10:42 -05:00
Edward Oakes 4155d5830f [serve] Replace actor error retry logic with max_task_retries (#8768) 2020-06-05 10:45:28 -05:00
Edward Oakes 0306e4d589 [serve] Refer to serve "instances," not "clusters" (#8746) 2020-06-02 15:16:29 -07:00
Edward Oakes 2e82e05e4b [serve] Add list_backends and list_endpoints (#8737) 2020-06-02 15:14:10 -07:00
Edward Oakes e91f095d98 [Serve] Remove ray_init_kwargs in serve.init (#8747) 2020-06-02 14:05:35 -07:00
Edward Oakes 57bf0e43f0 fix docstring (#8736) 2020-06-02 08:55:20 -07:00
Simon Mo 4cef1ee591 [Serve] Cleanup Router Implementation (#8718) 2020-06-01 19:21:28 -07:00
Edward Oakes 5bec951ece [docs] [serve] Deployment as a service on k8s docs (#8663) 2020-05-29 14:53:42 -07:00
krfricke e5b6566d28 Remove blocking flag from serve.init() (#8654) 2020-05-29 13:25:35 -07:00
Simon Mo 6b04664645 [Serve] Add Tutorial for Batch Inference (#8490) 2020-05-29 09:55:47 -07:00
Simon Mo 38399c9885 [Hotfix] [Serve] Disable Deployment Tutorial Test (#8641) 2020-05-27 10:40:40 -07:00
Bill Chambers fadd47e44e [docs] Ray Serve Documentation Overhaul (#8524) 2020-05-27 11:03:28 -05:00
Edward Oakes 137519e19d [serve] Remove start_server flag (#8620) 2020-05-26 14:34:18 -05:00
Edward Oakes 860eb6f13a Update named actor API (#8559) 2020-05-24 20:08:03 -05:00