Commit Graph

1634 Commits

Author SHA1 Message Date
Hersh Godse d17b35494d [tune] Save/Restore for Suggestion Algs (#5719) 2019-09-21 11:11:57 -07:00
Vince Jankovics 7e214fd95e [tune] TensorBoard HParams for TF2.0 (#5678) 2019-09-21 11:06:34 -07:00
Philipp Moritz a6dd794818 [Projects] Fix template path (#5716) 2019-09-16 19:58:54 -07:00
Philipp Moritz e4e1a57ca5 [Projects] Allow named sessions (#5706) 2019-09-16 13:00:46 -07:00
Richard Liaw 2b2eb4debb [tune] Checkpoint and Sync at end (#5699) 2019-09-15 15:58:58 -07:00
Robert Nishihara baac370099 Deprecate old global state API. (#5484)
* Deprecate old global state API.

* Remove unnecessary returns.
2019-09-15 09:13:15 -07:00
Eric Liang 09968a3c55 [revert] Disable monitor error logging to stdout #5692 2019-09-14 22:32:48 -07:00
Edward Oakes a8888c5ff4 [flaky test] Fix test_calling_start_ray_head (#5644) 2019-09-14 22:27:45 -07:00
Robert Nishihara 74a34b736d Call ray.put in ray.init() to speed up first object store access. (#5685) 2019-09-14 21:27:32 -07:00
Simon Mo 1560ace65a Use set comprehensions (#5707) 2019-09-14 15:44:25 -07:00
Edward Oakes a5d7de6aaf [core worker] Python core worker normal task submission (#5566) 2019-09-14 13:02:53 -07:00
Simon Mo 5f88823c49 [Serve] Rewrite Ray.Serve From Scratch (#5562)
* Commit and format files

* address stylistic concerns

* Replcae "Usage" by "Example" in doc

* Rename srv to serve

* Add serve to CI process; Fix 3.5 compat

* Improve determine_tests_to_run.py

* Quick cosmetic for determien_tests

* Address comments

* Address comments

* Address comment

* Fix typos and grammar

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

* Update python/ray/experimental/serve/global_state.py

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

* Use __init__ for Query and WorkIntent class

* Remove dataclasses dependency

* Rename oid to object_id for clarity

* Rename produce->enqueue_request, consume->dequeue_request

* Address last round of comment
2019-09-13 21:36:56 -07:00
Si-Yuan 4c964c0941 Initial implementation for pickle5 support (#5611) 2019-09-13 17:54:14 -07:00
Simon Mo fc9f03cd96 Fix queue actor init in setup_queue_actor fixture (#5676) 2019-09-13 12:35:44 -07:00
Eric Liang 3ed18d0b59 Fix edge case in autoscaler with poor bin packing (#5702)
* fix edge case

* fix for general case
2019-09-13 11:46:10 -07:00
Stephanie Wang 1d4a11a433 Only use git repo if .git exists (#5701) 2019-09-13 11:34:34 -07:00
Edward Oakes 07c4c6367a [core worker] Python core worker object interface (#5272) 2019-09-12 23:07:46 -07:00
Edward Oakes ee5db5b67f Raise error if space in redis password (#5673) 2019-09-11 20:58:39 -07:00
Eric Liang faeaa34bdd Deflake cluster heartbeat test (#5552) 2019-09-11 12:26:04 -07:00
Eric Liang 2fdefe19b7 Take into account queue length in autoscaling (#5684) 2019-09-11 11:31:35 -07:00
Philipp Moritz 9ce6dd9b88 [Projects] Add "session execute" (#5681) 2019-09-11 00:50:05 -07:00
Hersh Godse 336aef1774 [tune] Save and Restore for bayesopt (#5623) 2019-09-10 13:11:59 -07:00
Simon Mo 147e7d46ec [Flaky tests] FIx test fork (#5671)
* Start testing test_fork

Maybe queue actor takes too long to initialize, that's why we are
seeing "Many python processes started" since most of the python
tasks are blocked on ray.get

* Add a comment
2019-09-09 19:21:20 -07:00
Richard Liaw 0010f54378 Update Cloudpickle (#5643) 2019-09-09 17:17:29 -07:00
Kai Yang ed761900f6 [Java] Support direct actor call in Java worker (#5504) 2019-09-09 14:29:20 +08:00
Robert Nishihara 87adb5a3c8 Remove timeout in test_actor_lifetime_load_balancing. (#5659) 2019-09-08 16:10:59 -07:00
Eric Liang ebb431a95a Add internal_api.pin_object_data() for pinning arbitrary object ids (#5637)
* add intenral pin method

* add pin

* update
2019-09-08 15:05:00 -07:00
Kai Yang d8f5804690 Support metadata for passing by value task arguments (#5527) 2019-09-08 11:07:48 +08:00
Stephanie Wang cb7102f31e [projects] Wrap ProjectDefinition in a class (#5654) 2019-09-07 18:30:17 -07:00
Philipp Moritz d0125d4212 Fix log monitor process error when attempting to read raylet PID. (#5655) 2019-09-07 15:51:09 -07:00
Kai Yang 732336fc4f [Java] Support multiple workers in Java worker process (#5505) 2019-09-07 22:52:05 +08:00
Richard Liaw d89ceb3ee5 [tune] Fix numerical error (#5653) 2019-09-07 07:34:51 -07:00
Kai Yang 8a352a8e70 ray stop kills processes more carefully (#5508) 2019-09-06 17:49:12 +08:00
Devin Petersohn c33d6662ce Remove Modin from Ray wheels. (#5647)
There are several reasons for this:

* We no longer support python2
* There should be only 1 way of installing Modin
  * Issue management on these wheels
* I have never heard of anyone using this feature
* It is rarely kept up to date
* Modin depends on specific versions of Ray because of past API changes
2019-09-05 23:46:27 -07:00
Mitchell Stern ddadc18ef6 Fix bug in ray.errors and update its default behavior (#5576) 2019-09-05 13:18:57 -07:00
Stephanie Wang edcc56ea01 Project fixes and cleanups (#5632) 2019-09-05 11:55:42 -07:00
Eric Liang 19bbf1eb4d [rllib] Revert [rllib] Port DDPG to the build_tf_policy pattern (#5626) 2019-09-04 21:39:22 -07:00
Richard Liaw 34f6d2fc5c [tune] Update trainable docs and support hparams (#5558) 2019-09-04 12:44:42 -07:00
lanlin 3ea9062419 Lazily create summary writer for TF2 logger. (#5631) 2019-09-04 09:22:56 -07:00
Richard Liaw ad96d3c4fb [tune] Fix TB Memory Leak (#5629) 2019-09-03 23:44:12 -07:00
Richard Liaw 130b8f21da [tune] Global checkpointing for tune at end (#5499) 2019-09-03 15:36:25 -07:00
jichan3751 1711e202a3 [training] Tensorflow interface for MultiNode SGD (#5440) 2019-09-03 15:35:42 -07:00
Edward Oakes 4ed6ee0b1e Better error message for actor class inheritance (#5598) 2019-09-03 10:42:27 -07:00
lanlin c3b0c62290 Remove the unused argument cusomt_loggers in Experiment. (#5619) 2019-09-03 10:34:46 -07:00
Edward Oakes dfd2a45f69 Simplify symlinking and don't print warnings (#5615) 2019-09-02 13:31:10 -07:00
Eric Liang a101812b9f Replace --redis-address with --address in test, docs, tune, rllib (#5602)
* wip

* add tests and tune

* add ci

* test fix

* lint

* fix tests

* wip

* sugar dep
2019-09-01 16:53:02 -07:00
Richard Liaw c49b98cfc4 [tune] Add encoder for PBT (#5599)
* Add encoder

* Apply suggestions from code review
2019-09-01 15:27:42 -07:00
Si-Yuan 0292f99e6c Fix DeprecationWarning (#5608) 2019-09-01 15:21:32 -07:00
Edward Oakes 0cc0abf857 Create session_latest symlink for Ray sessions (#5580) 2019-08-31 22:14:54 -07:00
Eric Liang daf38c8723 [tune] Deprecate tune.function (#5601)
* remove tune function

* remove examples

* Update tune-usage.rst
2019-08-31 16:00:10 -07:00