Commit Graph
100 Commits
Author SHA1 Message Date
Simon MoandGitHub a25472c657 [Serve] Fix prometheus exporter label override (#9227) 2020-07-02 11:40:14 -07:00
Simon MoandGitHub be647b69ab [Serve] Performance: Use uvloop when possible (#9216) 2020-06-30 15:59:13 -07:00
Simon MoandGitHub 77933c922d Add scripts symlink back (#9219)
This partially reverts commit 43043ee4d5.
2020-06-30 13:25:59 -07:00
Simon MoandGitHub b6d425526d Move actor task submission to io service (#9093) 2020-06-23 10:07:33 -07:00
Simon MoandGitHub 2b5119218e [Serve] Raise exception when _scale_replicas is infeasible (#9005) 2020-06-21 15:38:58 -07:00
Simon MoandGitHub e89b8d37ae [Serve] Fix PyTorch Tutorial (#9019) 2020-06-18 15:41:43 -07:00
Simon MoandGitHub 1a1ddc74c4 [Serve] Add package reference and links keyword to docstring (#8955) 2020-06-15 18:47:59 -07:00
cf53b35147 [Serve] Add doc for model composition (#8871)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-06-10 11:09:22 -07:00
Simon MoandGitHub 7d52159d1a Fix Serve Flaky test_api::test_batching (#8867) 2020-06-09 16:49:17 -07:00
Simon MoandGitHub 6c3062906f [Serve] Batching in Worker Replica (#8709) 2020-06-09 11:29:16 -07:00
Simon MoandGitHub 5e2bd6ecb9 Fix asyncio re-entry error message (#8842) 2020-06-08 17:43:01 -07:00
Simon MoandGitHub 3b32cf14a7 Add release test runnning full asan python test (#8836) 2020-06-08 13:22:12 -07:00
Simon MoandGitHub c5544eb070 [Async] Remove Monitor + Cleanup Code (#8691) 2020-06-02 14:11:16 -07:00
Simon MoandGitHub a8e4ddbd57 Update Redis to 5.0.9 (#8722) 2020-06-02 14:10:07 -07:00
Simon MoandGitHub 4cef1ee591 [Serve] Cleanup Router Implementation (#8718) 2020-06-01 19:21:28 -07:00
Simon MoandGitHub 6b04664645 [Serve] Add Tutorial for Batch Inference (#8490) 2020-05-29 09:55:47 -07:00
Simon MoandGitHub b93d6813ae Build from source in Jenkins (#8255) 2020-05-28 09:38:16 -07:00
Simon MoandGitHub 38399c9885 [Hotfix] [Serve] Disable Deployment Tutorial Test (#8641) 2020-05-27 10:40:40 -07:00
Simon MoandGitHub ed2f434593 [Serve] Start Replicas in Parallel (#8433) 2020-05-20 19:46:03 -07:00
Simon MoandGitHub c9c84c87f4 [Serve] Add Instructions for GPU (#8495) 2020-05-19 18:33:58 -07:00
Simon MoandGitHub 122353c392 [Serve] Fix SKLearn example against newest version (#8428) 2020-05-13 14:09:57 -07:00
Simon MoandGitHub 501b936114 [Serve] Improve error message when result is not a list (#8378) 2020-05-10 17:18:06 -07:00
Simon MoandGitHub c5a5a5de89 [Serve] Refactor Metric System: Counter + Measure Support (#8114) 2020-05-06 17:44:02 -07:00
Simon MoandGitHub 1480bf4295 [Serve] Improve batch size inconsistency error (#8315) 2020-05-04 20:32:12 -07:00
Simon MoandGitHub ca929671b6 [Serve] Simplify Validation (#8316) 2020-05-04 20:31:23 -07:00
Simon MoandGitHub ec6631ae58 Pin redis-py version (#8290) 2020-05-02 22:09:02 -07:00
Simon MoandGitHub 1b1fe0cc5b Fix Serve long running test (#8223) 2020-04-29 09:32:39 -07:00
Simon MoandGitHub 101255f782 [Serve] RayServe TF, PyTorch, Sklearn Examples (#8156) 2020-04-28 22:24:55 -07:00
Simon MoandGitHub af3d3e778e [RayServe] Specify installation instruction in doc (#8220) 2020-04-28 14:38:10 -07:00
Simon MoandGitHub 13c14eac07 [Asyncio] Remove async init legacy code (#8177)
* [Asyncio] Remove async init legacy code

* Fix places that call async_init
2020-04-25 09:32:38 -07:00
Simon MoandGitHub 95e8ec8c47 [CI] Dashboard+ Tensorboard Lint Hotfix (#8125) 2020-04-21 16:52:58 -07:00
Simon MoandGitHub 7455610d5a Serve Doc: Quickstart (#7940) 2020-04-15 12:25:37 -07:00
Simon MoandGitHub 870271d51f [Serve] Call serve.init in function handler (#7947) 2020-04-09 11:46:15 -07:00
Simon MoandGitHub 59867dad75 Move Jenkins test to Github action (#7342) 2020-04-09 10:27:19 -07:00
Simon MoandGitHub a3181816b3 Add result from 0.8.4 release (#7876) 2020-04-02 15:31:03 -07:00
Simon MoandGitHub dc9b62e007 Deserialize Args in Event Loop Thread (#7806) 2020-03-30 18:28:13 -07:00
Simon MoandGitHub 353d7e107f [Serve] Improve Serialization (#7688) 2020-03-29 14:57:19 -07:00
Simon MoandGitHub 838c1e854f Add results from 0.8.3 release (#7745) 2020-03-27 11:14:15 -07:00
Simon MoandGitHub a519b4f2a9 [Serve] Enhancement in HTTP Methods and Multi-route support (#7709) 2020-03-24 20:25:05 -07:00
Simon MoandGitHub afad0ed085 [Serve] Add async, multi methods support for serve actors (#7682) 2020-03-23 00:45:26 -07:00
Simon MoandGitHub 89d959fd6a Stop gap solution for cython functions breaking in memory monitor (#7687) 2020-03-21 15:16:12 -07:00
Simon MoandGitHub ce0885a897 [Serve] UI Improvements (#7569) 2020-03-16 22:23:16 -07:00
Simon MoandGitHub 45ce40e5d4 Disable Travis Disk Cache (#7612)
There are some file sizes and memory issue with bazel disk cache
we will disable the cache and use remote cache exclusively for now
2020-03-16 00:18:01 -07:00
Simon MoandGitHub 3f1fcaa024 Blocking ray.get/wait inside async context will warn instead of error (#7262) 2020-03-14 22:02:30 -07:00
Simon MoandGitHub 31d63d3ca7 Fix global state actors() call (#7567) 2020-03-11 16:59:50 -07:00
Simon MoandGitHub 29b08ddc09 Improve release process from 0.8.2 (#7303) 2020-02-24 21:18:53 -08:00
Simon MoandGitHub b804d40c04 Stop vendoring pyarrow (#7233) 2020-02-19 19:01:26 -08:00
Simon MoandGitHub 7bef7031c2 Revert "Revert "Revert "Removing Pyarrow dependency (#7146)" (#7209) (#7214)" (#7232) 2020-02-19 13:35:29 -08:00
Simon MoandGitHub e8941b1b79 Revert "Revert "Removing Pyarrow dependency (#7146)" (#7209) (#7214) 2020-02-19 10:08:52 -08:00
Simon MoandGitHub 30de1286bd Use pip install setup.py (#7158) 2020-02-14 13:53:36 -08:00
Simon MoandGitHub 0e94e1dc2a [Asyncio] Increase recursion limit manually (#7142) 2020-02-12 14:15:36 -08:00
Simon MoandGitHub 039d2cde88 Change log level for OMP warning (#7114) 2020-02-11 14:15:38 -08:00
Simon MoandGitHub 0d5225c743 [Build] Use latest known tagged arrow image for linux build (#7115) 2020-02-11 11:17:48 -08:00
Simon MoandGitHub 0ddc389830 Fix documentation building with psutil issue (#7077) 2020-02-11 10:00:29 -08:00
Simon MoandGitHub bec92a8946 [Hotfix] Fix flake8 lint failing (#7118) 2020-02-10 19:57:21 -08:00
Simon MoandGitHub f6c09ff614 Add serve stress test (#7076) 2020-02-10 09:37:39 -08:00
Simon MoandGitHub a0ba4499ac [Serve] Fix batching bug 2020-02-05 14:18:19 -08:00
Simon MoandGitHub dd095c476a Move serve and asyncio tests to bazel (#6979) 2020-02-04 08:29:16 -08:00
Simon MoandGitHub 5e8ded344a [Serve] Fix flaky test with nursery double init (#6982) 2020-02-03 21:32:12 -08:00
Simon MoandGitHub 4e2c4302e8 Remove test_gather_benchmark (#6983) 2020-01-31 09:42:05 -08:00
Simon MoandGitHub 660eef6502 [Serve] Async Router (#6873) 2020-01-30 09:34:47 -08:00
1e3a34b223 Rewrite the async api documentation (#6936)
* Rewrite the async api documentation

* Apply suggestions from code review

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

* clearify comment

* Add quickstart

* Add reference for async in ray.get ray.wait docstring

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-01-30 09:34:09 -08:00
Simon MoandGitHub 5bdfc50bf6 Update the macos wheel name (#6961) 2020-01-29 15:23:43 -08:00
Simon MoandGitHub 26d749bc18 [Dashboard] Render HTML inline (#6932) 2020-01-28 10:39:22 -08:00
Simon MoandGitHub 396d7fafc8 UI improvement for asyncio (#6905) 2020-01-27 12:45:51 -08:00
Simon MoandGitHub 5f527816fe Fix async actor high cpu utilization when idle (#6877) 2020-01-22 16:07:08 -08:00
Simon MoandGitHub 4dd41844d0 Ignore blocking ray.wait if timeout is zero (#6891) 2020-01-22 16:05:34 -08:00
Simon MoandGitHub 8f246c17b5 Initialize async plasma for async actors (#6813)
* Initialize async plasma for async actors

* Address comment
2020-01-17 14:58:06 -08:00
6285851743 Add sphinx copy button (#6694)
* Add sphinx copy button

* Update requirements-doc.txt

Co-authored-by: Robert Nishihara <robertnishihara@gmail.com>
2020-01-04 19:31:49 -06:00
Simon MoandGitHub 9fe90cdafc Fix async actor recursion limitation (#6672)
* Do not start threadpool when using async

* Turn function_executor into a generator

* Add new test for high concurrency and bump the default

* Set direct call
2020-01-02 19:45:13 -06:00
Simon MoandGitHub d807d0bab6 Serve small fixes (#6539)
* Tmp db

* Lint

* Turn on direct call for serve tests
2019-12-18 23:08:59 -08:00
Simon MoandGitHub 26ec500ef9 Implement async get for direct actor call (#6339) 2019-12-18 11:50:21 -08:00
Simon MoandGitHub e530c37b0e Use localhost and set redis password by default (#6481) 2019-12-17 19:41:19 -08:00
Simon MoandGitHub 840d9c126f Move travis build script to after the deploy stage (#6518)
* move travis build script to after the deploy stage

* Add skip cleanup
2019-12-17 00:03:05 -08:00
Simon MoandRichard Liaw c61db84b8d Bump dev6->dev7 for two files not changed yet. (#6428) 2019-12-10 20:58:14 -08:00
Simon MoandGitHub ac6aa21411 Fix the autoscaler docker file to use rayproject (#6357) 2019-12-04 16:20:04 -08:00
Simon MoandGitHub 31113aeded Use rayproject repo (#6353) 2019-12-03 22:36:40 -08:00
Simon MoandGitHub 216ef8e41a Remove the encrypted docker password. Use web UI. (#6333) 2019-12-02 17:22:59 -08:00
Simon MoandGitHub 4033d65e4f Fix redis-server stoping in linux (#6296)
* Cleanup test_calling_start_ray_head

* Kill redis-server with args instead of comm

In linux, ps -o pid,comm output just redis-server instead of the
full executable path
2019-11-29 22:50:05 -08:00
Simon MoandEdward Oakes dd80c6e6d4 Hotfix make docker images building optional (#6309)
* Make docker build optional

* Fix syntax error
2019-11-27 20:52:21 -06:00
Simon MoandGitHub 22b305223a Build Docker Containers for Linux Wheels (#6233) 2019-11-27 17:05:36 -08:00
Simon MoandGitHub df453c2a2f Remove valgrind block (#6297) 2019-11-26 20:20:01 -08:00
Simon MoandEric Liang 1ca8c427e3 Consistent Name for Process Title (#6276)
* Consistent naming for setprotitle

* Address comments

* Add debug/verbose mode

* Fix test
2019-11-26 11:56:28 -08:00
Simon MoandGitHub c8b69727cd ray stop only kills process with ray keyword (#6257)
* Use psutil to kill processes

* Psutil as core requirement

* Revert "Psutil as core requirement"

This reverts commit d3235ce3d994d2bb7db39e3ad4a46049703898bb.

* Revert "Use psutil to kill processes"

This reverts commit de0ed874fed673f5e98715950688f418bbcc415c.

* Revert back to subproc

* Add comments, grep for ray as well

* SIGTERM
2019-11-24 16:32:07 -08:00
Simon MoandGitHub aa8d5d2f6c Rate limit asyncio actor (#6242) 2019-11-24 11:39:28 -08:00
Simon MoandGitHub 9f0d005ce6 Use jobs 50 (#6255) 2019-11-24 00:32:38 -08:00
Simon MoandGitHub f53f576120 Quiet Wget (#6244) 2019-11-22 14:32:14 -08:00
Simon MoandGitHub eb6a93c0f0 [hotfix] fix lint (#6236) 2019-11-21 18:30:57 -08:00
Simon MoandGitHub 57e101e648 [CI] Pass cloud cache secrets to linux wheel (#6232) 2019-11-21 14:41:13 -08:00
Simon MoandGitHub 29ba6bfc64 Basic Async Actor Call (#6183)
* Start trying to figure out where to put fibers

* Pass is_async flag from python to context

* Just running things in fiber works

* Yield implemented, need some debugging to make it work

* It worked!

* Remove debug prints

* Lint

* Revert the clang-format

* Remove unnecessary log

* Remove unncessary import

* Add attribution

* Address comment

* Add test

* Missed a merge conflict

* Make test pass and compile

* Address comment

* Rename async -> asyncio

* Move async test to py3 only

* Fix ignore path
2019-11-21 11:56:46 -08:00
Simon MoandPhilipp Moritz c4132b501b [CI] Add Remote Caching (#6210) 2019-11-21 11:36:36 -08:00
c75ada9e04 [Autoscaler][K8s] Enforce memory limit in k8s yaml (#6138)
* Enforce memory limit in k8s yaml

* Update python/ray/autoscaler/kubernetes/example-full.yaml

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

* Line wrap
2019-11-11 14:06:34 -08:00
Simon MoandGitHub fcb6bdbc39 [Doc] Document Actor.options API (#6099)
* Document Actor.options API

* Undocument _remote
2019-11-06 23:12:23 -08:00
Simon MoandGitHub c23eae5998 [Serve] Fix router-worker communication (#5961)
* Half way there, needs the strict queuing fix

* Fix scale down, use callback

* Cleanup

* Address commments

* Comment, nit

* Fix docstring
2019-11-04 11:29:21 -08:00
Simon MoandGitHub c8d7065bf3 [CI] Use rerunfailures instead of flaky (#6061)
* Use rerunfailures instead of flaky

* Lint
2019-11-01 13:59:03 -07:00
Simon MoandGitHub 7f5b3502da Implement Detached Actor (#6036)
* Arg propagation works

* Implement persistent actor

* Add doc

* Initialize is_persistent_

* Rename persistent->detached

* Address comment

* Make test passes

* Address comment

* Python2 compatiblity

* Fix naming, py2

* Lint
2019-11-01 10:28:23 -07:00
Simon MoandGitHub 56f3e96887 [Serve] Use ray's cloudpickle (#6051)
* Revert "Add cloudpickle as doc requirements (#6037)"

This reverts commit 03ce3b7c5b.

* Use ray's vendored cloudpickle
2019-10-30 15:21:09 -07:00
Simon MoandGitHub 4c4342c165 Bring back pytest-sugar (#6038)
* Add cloudpickle as doc requirements

* Bring back pytest-sugar

* Revert "Add cloudpickle as doc requirements"

This reverts commit 2206e9e62ee20d93638e115f07a3fc933cbad9a3.
2019-10-28 20:24:28 -07:00
Simon MoandGitHub 03ce3b7c5b Add cloudpickle as doc requirements (#6037) 2019-10-28 18:25:02 -07:00
Simon MoandGitHub 9e2c5f8218 [Serve] Put global state in remote actor (#5937)
* Making progress

* Impl done, start debugging

* Tests all pass

* Add test, fix

* Update doc

* Fix type
2019-10-28 11:43:47 -07:00