Commit Graph

124 Commits

Author SHA1 Message Date
Siyuan (Ryans) Zhuang f0dba6bd2b Code cleanup about python3 asyncio compat (#11134)
* cleanup python3 compat and others
2020-09-30 14:22:25 -07:00
Simon Mo 6cfc1a16a0 [Serve] Fix resource checking (#11084) 2020-09-28 18:10:43 -07:00
SangBin Cho 109481afd9 [Metric] custom metrics refinement (#10861)
* In progress

* In Progress.

* Addressed code review.

* Add unit tests.

* Add a simple doc.

* Fixed test failure.

* Fix all test failures from serve.

* Addressed code review.
2020-09-25 09:10:28 -07:00
Eric Liang 609c1b8acd Start moving ray internal files to _private module (#10994) 2020-09-24 22:46:35 -07:00
Simon Mo 7fbe076813 [Serve] Unwrap Flask Request from ServeHandle (#10845) 2020-09-22 12:44:23 -07:00
architkulkarni 102c498653 [Doc] Fix RayServeHandle doc (#10896) 2020-09-18 10:29:21 -07:00
Ian Rodney 5bc2ba38fd [docker] Detect CPUs in container correctly (#10507)
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-13 23:40:48 -07:00
architkulkarni 333f324b88 Run Serve Tests on Windows (#10682) 2020-09-10 15:54:37 -07:00
Simon Mo 8d5b8b2956 [Serve] Fix handle args data type issue (#10629) 2020-09-08 12:32:42 -07:00
architkulkarni c4c0857107 [Serve] Parametrize tests for pydantic backend (#10559) 2020-09-04 17:24:24 -07:00
Simon Mo 55b6c19d98 [Serve] Implement ServeHandle refactoring (#10527) 2020-09-04 15:50:56 -07:00
Edward Oakes 786f12edfd [serve] Serve client refactor (#10409) 2020-09-04 12:02:23 -05:00
Simon Mo 94374e1dd9 [Serve] Add Latency and Queue Size Metrics (#10535) 2020-09-03 17:33:37 -07:00
Simon Mo eff4375c3d [Serve] Produtionize Starlette Middlewares (#10529) 2020-09-03 17:31:38 -07:00
architkulkarni 0d93e92720 [Serve] Reimplement BackendConfig as pydantic model (#10389) 2020-09-03 19:16:17 -05:00
Simon Mo 65f17f2e14 [Serve] Refactor RequestMetadata and Query objects (#10483) 2020-09-01 18:15:31 -07:00
Richard Liaw cb438be146 [core] Move log_to_driver back to public (#10422) 2020-08-29 16:35:14 -07:00
Eric Liang 2a204260a8 [api] Second round of 1.0 API changes: exceptions, num_return_vals (#10377) 2020-08-28 19:57:02 -07:00
Eric Liang 519354a39a [api] Initial API deprecations for Ray 1.0 (#10325) 2020-08-28 15:03:50 -07:00
SangBin Cho 68c2dcd12b Fix. (#10390) 2020-08-28 08:22:23 -07:00
Eric Liang bd245a1c18 [api] Clean up and document Actor name / lifetime API (#10332) 2020-08-27 13:38:39 -07:00
architkulkarni eea7a86163 [Serve] add type hints for controller and backend_worker (#10288) 2020-08-27 10:20:36 -07:00
Simon Mo ed3fdd2c0b [Serve] Remove register_custom_serializer (#10331) 2020-08-25 21:20:43 -07:00
architkulkarni 07cd815e5a [Serve] Type hints for API (#10205) 2020-08-20 15:33:04 -07:00
Edward Oakes 888f0a2c60 [serve] Use ray.experimental.metrics (#10185) 2020-08-19 13:03:22 -05:00
Edward Oakes ba0f531da0 [serve] Remove SLO code and blist dependency (#10075) 2020-08-18 17:52:36 -05:00
architkulkarni fe5fcb6b9c [serve] backend and endpoint validation (#9954) 2020-08-13 11:56:50 -05:00
Edward Oakes ca37accc07 [serve] Add min and max limits to autoscaling (#9955) 2020-08-07 15:30:14 -05:00
Simon Mo c8da5555ab [Serve] Add preliminary middleware support (#9940) 2020-08-06 12:49:31 -07:00
Edward Oakes 38408574c4 [serve] Basic autoscaling policy (#9845) 2020-08-05 21:11:35 -05:00
Edward Oakes 55146d222f [serve] Detect node updates (#9828) 2020-08-04 15:57:21 -05:00
Robert Nishihara db0d6e8efa Make wait_for_condition raise exception when timing out. (#9710) 2020-07-26 22:56:32 -07:00
Simon Mo a078a21437 [Serve] Allow multiple HTTP servers. (#9523) 2020-07-24 12:41:20 -07:00
Simon Mo d8fd74d528 [Serve] Document Metric Infrastructure (#9389) 2020-07-21 14:52:18 -07:00
Ian Rodney b8fc259796 [serve] Rename to Controller (#9566) 2020-07-20 12:50:29 -07:00
Simon Mo d0398bf7e1 [Serve] Serialize Query object directly (#9490) 2020-07-20 10:10:07 -07:00
Simon Mo e78945db96 [Serve] Add internal instruction for running benchmarks (#9531) 2020-07-17 11:17:37 -07:00
Simon Mo 22a5c3d3ee Hotfix Lint for Serve (#9535) 2020-07-17 00:40:33 -07:00
Simon Mo 60a838f0f0 [Serve] Use pickle instead of clouldpickle (#9479) 2020-07-16 15:44:10 -07:00
Simon Mo 761b584814 [Serve] Improve buffering for simple cases (#9485) 2020-07-16 15:34:08 -07:00
Simon Mo d4a5d09dab [Serve] Merge router with HTTPProxy (#9225) 2020-07-10 13:52:48 -07:00
Hao Chen d49dadf891 Change Python's ObjectID to ObjectRef (#9353) 2020-07-10 17:49:04 +08:00
Sven Mika 4da0e542d5 [RLlib] DDPG and SAC eager support (preparation for tf2.x) (#9204) 2020-07-08 16:12:20 +02:00
Simon Mo a25472c657 [Serve] Fix prometheus exporter label override (#9227) 2020-07-02 11:40:14 -07:00
Simon Mo be647b69ab [Serve] Performance: Use uvloop when possible (#9216) 2020-06-30 15:59:13 -07:00
Edward Oakes 681bae709a [serve] Add backend config options to docstrings (#9193) 2020-06-30 10:53:17 -05:00
Edward Oakes 87e47c4a53 Fix serve dependencies (#9192) 2020-06-29 12:44:04 -05:00
mehrdadn 898e472425 Make test_utils.py use pipes to avoid file access conflicts on Windows (#9072)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-27 22:33:45 +02:00
Edward Oakes aa3fd62cac [serve] Add shadow traffic API (#9106) 2020-06-25 10:55:22 -05:00
Edward Oakes c9010eb8ad [serve] Add serve.shutdown() (#8766) 2020-06-23 13:42:03 -05:00