Commit Graph

243 Commits

Author SHA1 Message Date
Edward Oakes 58dc70f90e [minor] Remove get_global_worker(), RuntimeContext (#7638) 2020-03-20 15:45:29 -05:00
ijrsvt 46953c53b1 Cleanup Plasma Async Callback (#7452) 2020-03-16 10:12:44 -07:00
Edward Oakes 0c254295b0 Remove experimental.signal API (#7477)
* Remove experimental.signal API

* fix test
2020-03-09 16:03:36 -07:00
Edward Oakes b4e2d5317e Remove experimental.NoReturn (#7475) 2020-03-09 11:09:36 -07:00
Edward Oakes 0abcca258f Add entries to in-memory store on Put() (#7085) 2020-03-04 10:17:27 -08:00
ijrsvt fb76092d75 Re-route asyncio plasma code path through raylet instead of direct plasma connection (#7234) 2020-03-03 15:43:46 -05:00
ijrsvt 584645cc7d Fix Experimental Async API (#7391) 2020-03-02 22:24:20 -06:00
Edward Oakes d9027acaf2 Deprecate non-direct-call API (#7336) 2020-02-27 10:37:23 -08:00
Simon Mo b804d40c04 Stop vendoring pyarrow (#7233) 2020-02-19 19:01:26 -08:00
Simon Mo 7bef7031c2 Revert "Revert "Revert "Removing Pyarrow dependency (#7146)" (#7209) (#7214)" (#7232) 2020-02-19 13:35:29 -08:00
Simon Mo e8941b1b79 Revert "Revert "Removing Pyarrow dependency (#7146)" (#7209) (#7214) 2020-02-19 10:08:52 -08:00
Eric Liang 0aa9373d62 Revert "Removing Pyarrow dependency (#7146)" (#7209)
This reverts commit 2116fd3bca.
2020-02-18 14:12:06 -08:00
Eric Liang 5df801605e Add ray.util package and move libraries from experimental (#7100) 2020-02-18 13:43:19 -08:00
ijrsvt 2116fd3bca Removing Pyarrow dependency (#7146) 2020-02-17 18:00:13 -08:00
Alind Khare c6d768be14 [Serve] Added support for no http route services (#7010) 2020-02-17 11:31:30 -08:00
Richard Liaw 94e2fcea2e [sgd] fp16 (apex) and scheduler support + move examples page (#7061)
* Init fp16

* fp16 and schedulers

* scheduler linking and fp16

* to fp16

* loss scaling and documentation

* more documentation

* add tests, refactor config

* moredocs

* more docs

* fix logo, add test mode, add fp16 flag

* fix tests

* fix scheduler

* fix apex

* improve safety

* fix tests

* fix tests

* remove pin memory default

* rm

* fix

* Update doc/examples/doc_code/raysgd_torch_signatures.py

* fix

* migrate changes from other PR

* ok thanks

* pass

* signatures

* lint'

* Update python/ray/experimental/sgd/pytorch/utils.py

* Apply suggestions from code review

Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>

* should address most comments

* comments

* fix this ci

* fix tests'

* testmode

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-02-16 19:04:08 -08:00
Edward Oakes dc5a27dac0 Move ray.experimental.multiprocessing to ray.util.multiprocessing (#7149) 2020-02-14 16:17:05 -08:00
Alind Khare f146d05b36 [Serve] Added support for composing arbitrary DAGs (#7015) 2020-02-07 17:55:26 -08:00
Simon Mo a0ba4499ac [Serve] Fix batching bug 2020-02-05 14:18:19 -08:00
Simon Mo dd095c476a Move serve and asyncio tests to bazel (#6979) 2020-02-04 08:29:16 -08:00
Simon Mo 5e8ded344a [Serve] Fix flaky test with nursery double init (#6982) 2020-02-03 21:32:12 -08:00
Edward Oakes 92525f35d1 Remove raylet client from Python worker (#6018) 2020-01-31 18:23:01 -08:00
Simon Mo 4e2c4302e8 Remove test_gather_benchmark (#6983) 2020-01-31 09:42:05 -08:00
Maksim Smolin 64c8996a43 [raysgd] Update to fix examples out of the box (#6966)
* Update tf-example-sgd dependencies, AMI, and instance type

* Make PyTorch dependency optional

* Re-implement optional torch import

* Update tensorflow_train_example

* Setup tf-example-sgd config for SGD development

* Document the MultiWorkerMirroredStrategy behavior

* Run scripts/format

* Undo GPU default for CI

* Remove dev deploy file_mounts

* Update docs on tf_runner and tf_trainer

* Fix formatting

* Remove the debug file-mounts again

* Disable cifar example GPU usage by default so CI runs properly

* Mark failing PyTorch test as flaky

* Clarify the tf SGD sanity check

* Run format script

* Update tf-example-sgd.yaml

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-01-31 01:16:57 -08:00
Amog Kamsetty c8bf0715a6 [Parallel Iterator] Local Shuffle (#6921)
* adding local shuffle and corresponding tests

* fix quotes

* addressing comments and adding seed argument

* formatting

* fix formatting issues

* change test size from small to medium

* addressing comments
2020-01-30 12:27:38 -08:00
Ameer Haj Ali b8135da122 Adding dependencies for scikit-learn in travis (#6969)
* Revert "Revert "Support of scikit-learn with ray joblib backend (#6925)" (#6957)"

This reverts commit 86100bc119.

* adding scikit-learn to dependencies
2020-01-30 09:46:54 -08:00
Simon Mo 660eef6502 [Serve] Async Router (#6873) 2020-01-30 09:34:47 -08:00
Eric Liang 86100bc119 Revert "Support of scikit-learn with ray joblib backend (#6925)" (#6957)
This reverts commit a7ecda6017.
2020-01-29 14:56:09 -08:00
Richard Liaw 037aa2b961 [sgd] Refactor PyTorch SGD Documentation. (#6910)
* Refactor documentation and directory structurre

* update loss

* ,ore examples

* fix comments

* more code

* svgs

* formatting

* more_docs

* more writing

* comments ready

* move

* whitespace

* examples

* fix

* bold

* pytorch

* batch

* fix

* fix test

* Apply suggestions from code review

* quarantinegp

* tests/

* fix missing
2020-01-29 08:51:01 -08:00
Ameer Haj Ali a7ecda6017 Support of scikit-learn with ray joblib backend (#6925) 2020-01-27 15:00:00 -06:00
Simon Mo 396d7fafc8 UI improvement for asyncio (#6905) 2020-01-27 12:45:51 -08:00
Ameer Haj Ali 9f9c3f5026 adding context parameter for pool with a warning for not being supported (#6776) 2020-01-17 16:57:18 -06:00
Edward Oakes 30776450a3 num_cpus=1 by default in Pool (#6812) 2020-01-17 13:28:25 -06:00
Richard Liaw 232be5a058 [sgd] fault tolerance for pytorch + revamp documentation (#6465) 2020-01-16 18:38:27 -08:00
Edward Oakes 3ea3b56eb1 Hotfix missing fields in multiprocessing.Pool (#6784) 2020-01-13 16:39:33 -06:00
Sven 60d4d5e1aa Remove future imports (#6724)
* Remove all __future__ imports from RLlib.

* Remove (object) again from tf_run_builder.py::TFRunBuilder.

* Fix 2xLINT warnings.

* Fix broken appo_policy import (must be appo_tf_policy)

* Remove future imports from all other ray files (not just RLlib).

* Remove future imports from all other ray files (not just RLlib).

* Remove future import blocks that contain `unicode_literals` as well.
Revert appo_tf_policy.py to appo_policy.py (belongs to another PR).

* Add two empty lines before Schedule class.

* Put back __future__ imports into determine_tests_to_run.py. Fails otherwise on a py2/print related error.
2020-01-09 00:15:48 -08:00
Robert Nishihara 39a3459886 Remove (object) from class declarations. (#6658) 2020-01-02 17:42:13 -08:00
Eric Liang 895f2727fb Add experimental parallel iterators API (#6644) 2020-01-02 13:45:26 -08:00
Robert Nishihara 480206eef8 Remove some Python 2 compatibility code. (#6624) 2019-12-31 17:14:58 -08:00
Robert Nishihara d2c6457832 Remove public facing references to --redis-address. (#6631) 2019-12-31 13:21:53 -08:00
Philipp Moritz 735f282494 Use 0.9.0.dev0 as the version tag (#6630) 2019-12-30 10:14:07 -08:00
Edward Oakes 2a66529fb7 Add multiprocessing.Pool API (#6194) 2019-12-29 21:40:58 -06:00
alindkhare a76fadb899 [Serve] Adding BackendConfig (#6541) 2019-12-27 23:34:50 -06:00
zhu-eric 65297e65f0 Experimental Actor Pool (#6055)
* mod_table

* Example fix for gallery

* lint

* nit

* nit

* fix

* gallery

* remove table for now

* training, object store, tune, actors, advanced

* start tf code

* first cut tf

* yapf

* pytorch

* add torch example

* torch

* parallel

* tune

* tuning

* reviewsready

* finetune

* fix

* move_code

* update conf

* compile

* init hyperparameter

* Start images

* overview

* extra

* fix

* works

* update-ps-example

* param_actor

* fix

* examples

* simple

* simplify_pong

* flake8 and run hyperopt

* add comments

* add comments

* add suggestion

* add suggestion

* suggestions

* add suggestion

* add suggestions

* fixed in wrong area

* last edit

* finish changes

* add line

* format

* reset

* tests and docs

* fix tests

* bazelify

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2019-12-26 14:35:10 -08:00
Yuhao Yang be23b3ac41 [sgd] show training result for examples (#6552) 2019-12-26 02:15:43 +01:00
mehrdadn 50fb26de68 Fix FutureWarning: Using a non-tuple sequence for multidimensional indexing is deprecated; use arr[tuple(seq)] instead of arr[seq]. In the future this will be interpreted as an array index, arr[np.array(seq)], which will result either in an error or a different result. (#6568) 2019-12-22 13:02:34 -08:00
Simon Mo d807d0bab6 Serve small fixes (#6539)
* Tmp db

* Lint

* Turn on direct call for serve tests
2019-12-18 23:08:59 -08:00
alindkhare d78a1062db [Serve] Pluggable Queueing Policy (#6492) 2019-12-18 21:28:38 -08:00
Simon Mo 26ec500ef9 Implement async get for direct actor call (#6339) 2019-12-18 11:50:21 -08:00
Eric Liang 1a1324d2a2 Bump version from 0.8.0.dev6 -> 0.9.0.dev (#6508) 2019-12-16 23:57:42 -08:00