Commit Graph

118 Commits

Author SHA1 Message Date
Eric Liang 81ee887f91 Preserve the original exception type when converting to RayTaskError (#5799) 2019-09-28 17:03:15 -07:00
Eric Liang 493364d3bd [autoscaler] Add unit tests for stopped node caching, fix flaky tests (#5793) 2019-09-27 22:36:09 -07:00
Edward Oakes 86610a30c9 [flaky test] Fix flaky checkpointing tests (#5791)
* Fix flaky checkpointing tests

* Fix checkpoint test logic

* Fix exception matching

* timeout exception

* Fix import

* fix build
2019-09-27 11:03:07 -07:00
Philipp Moritz 01d6362472 Serialize StringIO with pickle (#5781) 2019-09-26 12:55:14 -07:00
Robert Nishihara 18ce7bda2b Fix flaky test_actors_and_tasks_with_gpus_version_two test. (#5756) 2019-09-25 11:47:47 -07:00
Edward Oakes d499601bd7 Fix flaky checkpoint tests (#5778) 2019-09-25 10:55:17 -07:00
Mitchell Stern 98dcc1d440 [Dashboard] Add initial version of new dashboard (#5730) 2019-09-23 08:50:40 -07:00
Philipp Moritz 5f5873b182 [Projects] Start multiple sessions via session start (#5740) 2019-09-22 01:36:23 -07:00
Edward Oakes a8888c5ff4 [flaky test] Fix test_calling_start_ray_head (#5644) 2019-09-14 22:27:45 -07:00
Si-Yuan 4c964c0941 Initial implementation for pickle5 support (#5611) 2019-09-13 17:54:14 -07:00
Simon Mo fc9f03cd96 Fix queue actor init in setup_queue_actor fixture (#5676) 2019-09-13 12:35:44 -07:00
Eric Liang 3ed18d0b59 Fix edge case in autoscaler with poor bin packing (#5702)
* fix edge case

* fix for general case
2019-09-13 11:46:10 -07:00
Edward Oakes 07c4c6367a [core worker] Python core worker object interface (#5272) 2019-09-12 23:07:46 -07:00
Eric Liang faeaa34bdd Deflake cluster heartbeat test (#5552) 2019-09-11 12:26:04 -07:00
Eric Liang 2fdefe19b7 Take into account queue length in autoscaling (#5684) 2019-09-11 11:31:35 -07:00
Philipp Moritz 9ce6dd9b88 [Projects] Add "session execute" (#5681) 2019-09-11 00:50:05 -07:00
Simon Mo 147e7d46ec [Flaky tests] FIx test fork (#5671)
* Start testing test_fork

Maybe queue actor takes too long to initialize, that's why we are
seeing "Many python processes started" since most of the python
tasks are blocked on ray.get

* Add a comment
2019-09-09 19:21:20 -07:00
Robert Nishihara 87adb5a3c8 Remove timeout in test_actor_lifetime_load_balancing. (#5659) 2019-09-08 16:10:59 -07:00
Stephanie Wang cb7102f31e [projects] Wrap ProjectDefinition in a class (#5654) 2019-09-07 18:30:17 -07:00
Devin Petersohn c33d6662ce Remove Modin from Ray wheels. (#5647)
There are several reasons for this:

* We no longer support python2
* There should be only 1 way of installing Modin
  * Issue management on these wheels
* I have never heard of anyone using this feature
* It is rarely kept up to date
* Modin depends on specific versions of Ray because of past API changes
2019-09-05 23:46:27 -07:00
Mitchell Stern ddadc18ef6 Fix bug in ray.errors and update its default behavior (#5576) 2019-09-05 13:18:57 -07:00
Stephanie Wang edcc56ea01 Project fixes and cleanups (#5632) 2019-09-05 11:55:42 -07:00
Edward Oakes 4ed6ee0b1e Better error message for actor class inheritance (#5598) 2019-09-03 10:42:27 -07:00
Eric Liang a101812b9f Replace --redis-address with --address in test, docs, tune, rllib (#5602)
* wip

* add tests and tune

* add ci

* test fix

* lint

* fix tests

* wip

* sugar dep
2019-09-01 16:53:02 -07:00
Eric Liang 3e70daba74 Warn on resource deadlock; improve object store error messages (#5555)
* wip

* wip

* wip

* wip

* wip

* add impl

* second

* warn once
2019-08-30 16:45:54 -07:00
Eric Liang bea43c85b1 Ref count objects created with ray.put (#5590)
* wip

* add weakref option

* tune util

* test ref

* doc

* fix tests
2019-08-30 16:43:23 -07:00
Philipp Moritz 04b869678e Fix O(n^2) behavior in the log_monitor (#5569) 2019-08-29 14:46:31 -07:00
Philipp Moritz ddfababb82 Fix log files being opened as unicode files (#5545) 2019-08-27 12:47:00 -07:00
Eric Liang d20696300e Fix autoscaler format string for memory (#5542)
* add format string

* fix cast
2019-08-26 23:25:11 -07:00
Eric Liang ff73b67154 fix test (#5544) 2019-08-26 23:24:40 -07:00
Philipp Moritz f1dcce5a47 [projects] Add named commands to sessions (#5525) 2019-08-26 14:16:17 -07:00
Eric Liang e2e30ca507 Ray, Tune, and RLlib support for memory, object_store_memory options (#5226) 2019-08-21 23:01:10 -07:00
Simon Mo 341c6926e7 [Project] Add Basic Session CLI Commands (#5433) 2019-08-19 10:14:45 -07:00
Edward Oakes 0440c00019 Use subprocess.check_output in tests (#5465) 2019-08-17 22:25:17 -07:00
Edward Oakes c7ae4e5e1f Check for dead processes in blocked ray start (#5458) 2019-08-17 20:44:08 -07:00
Hao Chen 03d05c8765 Fix test_logging_to_driver and test_not_logging_to_driver (#5462) 2019-08-17 18:06:08 +08:00
Hao Chen 657ce4b3c7 increase timeout for test_actor_lifetime_load_balancing (#5463) 2019-08-17 17:25:53 +08:00
Robert Nishihara bb31620168 Add test for mutually recursive remote functions. (#5349) 2019-08-17 00:46:44 -07:00
Simon Mo d9b45cceec [Project] Implementing Project CLI (#5397) 2019-08-08 21:28:25 -07:00
Richard Liaw ed89897a31 [tune,autoscaler] Test yaml, add better distributed docs (#5403) 2019-08-08 00:59:23 -07:00
Qing Wang d372f24e3c [ID Refactor] Refactor ActorID, TaskID and ObjectID (#5286)
* Refactor ActorID, TaskID on the Java side.

Left a TODO comment

WIP for ObjectID

ADD test

Fix

Add java part

Fix Java test

Fix

Refine test.

Enable test in CI

* Extra a helper function.

* Resolve TODOs

* Fix Python CI

* Fix Java lint

* Update .travis.yml

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Address some comments.

Address some comments.

Add id_specification.rst

Reanme id_specification.rst to id_specification.md

typo

Address zhijun's comments.

Fix test

Address comments.

Fix lint

Address comments

* Fix test

* Address comments.

* Fix build error

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Address comments

* Update src/ray/common/id.h

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/common/id.h

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/common/id.h

Co-Authored-By: Stephanie Wang <swang@cs.berkeley.edu>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update src/ray/design_docs/id_specification.md

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comments.

* Address comments.

* Address comments.

* Update C++ part to make sure task id is generated determantic

* WIP

* Fix core worker

* Fix Java part

* Fix comments.

* Add Python side

* Fix python

* Address comments

* Fix linting

* Fix

* Fix C++ linting

* Add JobId() method to TaskID

* Fix linting

* Update src/ray/common/id.h

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/api/src/main/java/org/ray/api/id/TaskId.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/api/src/main/java/org/ray/api/id/TaskId.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/api/src/main/java/org/ray/api/id/ActorId.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comments

* Add DriverTaskId embeding job id

* Fix tests

* Add python dor_fake_driver_id

* Address comments and fix linting

* Fix CI
2019-08-07 11:04:51 +08:00
Philipp Moritz e8d9cfc1f1 Ray projects schema and validation (#5329) 2019-08-06 14:36:04 -07:00
Hao Chen 991e71dde6 Submit task asynchronously from raylet client (#5313) 2019-07-30 12:58:57 -07:00
Simon Mo 196495a4de Fix Redis Test (#5302) 2019-07-30 00:22:16 -07:00
micafan b3bcf59148 Rename ClientTableData to GcsNodeInfo (#5251) 2019-07-30 11:22:47 +08:00
Eric Liang 3bdd114282 [rllib] Better example rnn envs (#5300) 2019-07-28 14:07:18 -07:00
Qing Wang 1465a30ea9 Fix releasing CPUs incorrectly when actor creation task blocked. (#5271)
* Fix

* Remove useless log

* Address

* Fix typo

* sleep
2019-07-28 15:46:17 +08:00
Richard Liaw 9c00616cdc Retry and exception for hang on memory store full (#5143) 2019-07-27 01:20:13 -07:00
Daniel Edgecumbe 06fec63c87 [autoscaler] Add a 'request_cores' function for manual autoscaling (#4754) 2019-07-26 17:14:45 -07:00
Stephanie Wang 3321555975 Increase timeout for ray.wait test (#5273)
* Increase test timeout for ray.wait

* make sure the actor is scheduled
2019-07-25 14:23:46 -07:00