Commit Graph

156 Commits

Author SHA1 Message Date
Simon Mo 1f7a4806ff [Serve] Fix Flask Request self reference (#12560)
* [Serve] Fix Flask Request self reference

* Working flag

* Fix
2020-12-03 10:45:04 -06:00
Edward Oakes 8058c1eb54 [serve] Add option to not start HTTP servers (#11627) 2020-12-02 16:49:34 -06:00
Simon Mo 7022278ce9 Deflake Serve tests (#12542) 2020-12-01 13:42:21 -08:00
Simon Mo ef1b0c13c3 Async Future Throws RayError as well (#12419) 2020-12-01 13:07:43 -08:00
Simon Mo f596113fc7 [Core] Actor Retries Out of Order Tasks on Restart (#12338) 2020-12-01 09:35:54 -08:00
Edward Oakes e72147de38 Fix Serve typo (#12524) 2020-11-30 23:15:42 -08:00
Ian Rodney e422ace053 [serve] Create CurrentState & GoalState (#12369) 2020-11-30 17:34:30 -08:00
Ian Rodney 679492a235 [serve] Use Long Polling in Backend Worker (#12093) 2020-11-25 12:11:38 -08:00
Edward Oakes 4ada3e4c99 [serve] Incremental change towards async control loop for replica startup (#12281) 2020-11-24 13:06:08 -06:00
Edward Oakes 135f2e0602 [serve] Only use typed BackendConfig in controller (#12275) 2020-11-23 20:56:04 -06:00
Edward Oakes be2187f942 Remove use_legacy_config tests (#12272) 2020-11-23 20:30:50 -06:00
Ian Rodney 1cf95cb081 [Serve] Remove old report-queue-code (#12211) 2020-11-23 12:42:05 -08:00
Simon Mo d200f620ee Deflake test_router (#12175) 2020-11-19 18:37:46 -08:00
Simon Mo d7c95a4a90 [Serve] Rewrite Router to be Embeddable (#12019) 2020-11-17 08:28:18 -08:00
Simon Mo 277558895d [Serve] Introduce Long Polling (#11905) 2020-11-13 13:17:20 -08:00
Ian Rodney 1d158dda32 [serve] Rename to use replicas, not workers (#11822) 2020-11-10 11:36:15 -08:00
Edward Oakes 1c132f2ff8 [serve] Improve DEBUG logging for understanding perf (#11838) 2020-11-09 14:10:42 -06:00
architkulkarni adcaabcd64 [Serve] Reconfigure backend class at runtime (#11709) 2020-11-09 14:04:51 -06:00
architkulkarni 347e871409 [Serve] Add dependency management (#11743) 2020-11-05 16:39:37 -06:00
Ian Rodney 9527220a86 [serve] Fix Controller Crashes on Win (#11792) 2020-11-03 16:54:16 -08:00
Ian Rodney c3074f559c [serve] Split out metadata for checkpointing (#11533) 2020-11-03 12:41:24 -08:00
Philipp Moritz 39ce0eadbe Ray PDB support (#11739) 2020-11-03 09:49:23 -08:00
Ian Rodney 171e02c684 [serve] re-enable serve-controller-crash test (#11579) 2020-11-02 11:22:09 -08:00
Simon Mo 46afec5660 Mute asyncio warning for Serve (#11682) 2020-10-28 17:05:42 -07:00
Simon Mo fe4a78b7c7 [Hotfix] Pin Pydantic Version (#11622) 2020-10-26 16:52:19 -07:00
architkulkarni 1ce0c4965b [Serve] Update front page of serve doc (#11421) 2020-10-23 12:01:04 -07:00
Simon Mo 7111a424af [Serve] Add regression test for #11437 (#11539) 2020-10-22 10:45:18 -07:00
Simon Mo 2c5cb95b42 [Serve] Get ServeHandle on the same node (#11477) 2020-10-20 10:44:23 -07:00
herve-alanaai 436202bcfd [docs] Fix typos in documentation (#11414) 2020-10-15 17:00:48 -07:00
Simon Mo 866193b01c Fix cluster yaml for serve benchmarks (#11383)
- Separate out single node and multiple node yamls
- Remove cluster_synced_files, somehow it breaks for me
2020-10-13 19:30:18 -07:00
architkulkarni 6676b30eef [Serve] Serve multi node tests (#10980) 2020-10-07 10:57:40 -07:00
Simon Mo 68106425db [Serve] Disable serialization for client and print helpful msg (#11181) 2020-10-07 10:50:30 -07:00
Siyuan (Ryans) Zhuang f0dba6bd2b Code cleanup about python3 asyncio compat (#11134)
* cleanup python3 compat and others
2020-09-30 14:22:25 -07:00
Simon Mo 6cfc1a16a0 [Serve] Fix resource checking (#11084) 2020-09-28 18:10:43 -07:00
SangBin Cho 109481afd9 [Metric] custom metrics refinement (#10861)
* In progress

* In Progress.

* Addressed code review.

* Add unit tests.

* Add a simple doc.

* Fixed test failure.

* Fix all test failures from serve.

* Addressed code review.
2020-09-25 09:10:28 -07:00
Eric Liang 609c1b8acd Start moving ray internal files to _private module (#10994) 2020-09-24 22:46:35 -07:00
Simon Mo 7fbe076813 [Serve] Unwrap Flask Request from ServeHandle (#10845) 2020-09-22 12:44:23 -07:00
architkulkarni 102c498653 [Doc] Fix RayServeHandle doc (#10896) 2020-09-18 10:29:21 -07:00
Ian Rodney 5bc2ba38fd [docker] Detect CPUs in container correctly (#10507)
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-13 23:40:48 -07:00
architkulkarni 333f324b88 Run Serve Tests on Windows (#10682) 2020-09-10 15:54:37 -07:00
Simon Mo 8d5b8b2956 [Serve] Fix handle args data type issue (#10629) 2020-09-08 12:32:42 -07:00
architkulkarni c4c0857107 [Serve] Parametrize tests for pydantic backend (#10559) 2020-09-04 17:24:24 -07:00
Simon Mo 55b6c19d98 [Serve] Implement ServeHandle refactoring (#10527) 2020-09-04 15:50:56 -07:00
Edward Oakes 786f12edfd [serve] Serve client refactor (#10409) 2020-09-04 12:02:23 -05:00
Simon Mo 94374e1dd9 [Serve] Add Latency and Queue Size Metrics (#10535) 2020-09-03 17:33:37 -07:00
Simon Mo eff4375c3d [Serve] Produtionize Starlette Middlewares (#10529) 2020-09-03 17:31:38 -07:00
architkulkarni 0d93e92720 [Serve] Reimplement BackendConfig as pydantic model (#10389) 2020-09-03 19:16:17 -05:00
Simon Mo 65f17f2e14 [Serve] Refactor RequestMetadata and Query objects (#10483) 2020-09-01 18:15:31 -07:00
Richard Liaw cb438be146 [core] Move log_to_driver back to public (#10422) 2020-08-29 16:35:14 -07:00
Eric Liang 2a204260a8 [api] Second round of 1.0 API changes: exceptions, num_return_vals (#10377) 2020-08-28 19:57:02 -07:00