Commit Graph

558 Commits

Author SHA1 Message Date
Kai Fricke 088f8ebb69 [tune] Add algorithms for search space conversion (#10621) 2020-09-07 13:44:16 -07:00
Kai Fricke c5e9bafe15 [tune] Fix flaky test in test_sample (#10602) 2020-09-06 10:29:48 -07:00
Richard Liaw 551c597312 [tune] API revamp fix (#10518) 2020-09-05 15:34:53 -07:00
Sumanth Ratna 54215ff287 [tune] implement shim instantiation (#10456)
* Create ray.tune.suggest.create.create_scheduler

* Update __init__.py

* Resolve conflict in __init__.py

* Create ray.tune.schedulers.create.create_scheduler

* Update __init__.py

* Move create_scheduler to tune.schedulers.__init__

* Move create_searcher to tune.suggest.__init__

* Delete tune.suggest.create

* Delete tune.schedulers.create

* Update imports for shim functions in tune.__init__

* Remove shim from tune.suggest.__init__.__all__

* Remove shim from tune.schedulers.__init__.__all__

* Add ShimCreationTest

* Move ShimCreationTest to test_api

* Delete test_shim.py

* Add docstring for ray.tune.create_scheduler

* Add docstring to ray.tune.create_searcher

* Fix typo in ray.tune.create_scheduler docstring

* Fix lint errors in tune.schedulers.__init__

* Fix lint errors in tune.suggest.__init__

* Fix lint errors in tune.suggest.__init__

* Fix lint errors in tune.schedulers.__init__

* Fix imports in test_api

* Fix lint errors in test_api

* Fix kwargs in create_searcher

* Fix kwargs in create_scheduler

* Merge branch 'master' into shim-instantiation

* Update use-case in docs in tune.create_scheduler

* Update use-case in docs in tune.create_searcher

* Remove duplicate pytest run from test_api

* Add check to create_searcher


Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Add check to create_scheduler

* lint

* Compare types of instances in test_api

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Add tune.create_searcher to docs

* Fix doc build

* Fix tests

* Add tune.create_scheduler to docs

* Fix tests

* Fix lint errors

* Update Ax search for master

* Fix metric kwarg for Ax in test_api

* Fix doc build

* Fix HyperOptSearch import in test_api

* Fix HyperOptSearch import in create_searcher

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-05 09:36:42 -07:00
Kai Fricke 2fac66650d [tune] extend search space api docs (#10576)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-04 18:39:51 -07:00
Kai Fricke 6b6780a108 [tune] Allow trials to remain paused in BOHB (#10531)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-04 15:29:33 -07:00
Kai Fricke 2e49e22f21 [tune] Add test_sample to bazel BUILD (#10566) 2020-09-04 09:09:02 -07:00
Kai Fricke 5c3d4a6670 [tune] added MXNet integration callbacks (#10533) 2020-09-03 18:06:44 -07:00
Richard Liaw 43a7a64b30 [tune] horovod trainable (#10304) 2020-09-03 16:53:35 -07:00
krfricke 91535e9102 [tune] Refactored Keras integration callbacks (#10509) 2020-09-03 10:16:08 -07:00
krfricke 06af62ba91 [tune] refactor tune search space (#10444)
* Added basic functionality and tests

* Feature parity with old tune search space config

* Convert Optuna search spaces

* Introduced quantized values

* Updated Optuna resolving

* Added HyperOpt search space conversion

* Convert search spaces to AxSearch

* Convert search spaces to BayesOpt

* Added basic functionality and tests

* Feature parity with old tune search space config

* Convert Optuna search spaces

* Introduced quantized values

* Updated Optuna resolving

* Added HyperOpt search space conversion

* Convert search spaces to AxSearch

* Convert search spaces to BayesOpt

* Re-factored samplers into domain classes

* Re-added base classes

* Re-factored into list comprehensions

* Added `from_config` classmethod for config conversion

* Applied suggestions from code review

* Removed truncated normal distribution

* Set search properties in tune.run

* Added test for tune.run search properties

* Move sampler initializers to base classes

* Add tune API sampling test, fixed includes, fixed resampling bug

* Add to API docs

* Fix docs

* Update metric and mode only when set. Set default metric and mode to experiment analysis object.

* Fix experiment analysis tests

* Raise error when delimiter is used in the config keys

* Added randint/qrandint to API docs, added additional check in tune.run

* Fix tests

* Fix linting error

* Applied suggestions from code review. Re-aded tune.function for the time being

* Fix sampling tests

* Fix experiment analysis tests

* Fix tests and linting error

* Removed unnecessary default_config attribute from OptunaSearch

* Revert to set AxSearch default metric

* fix-min-max

* fix

* nits

* Added function check, enhanced loguniform error message

* fix-print

* fix

* fix

* Raise if unresolved values are in config and search space is already set

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-03 09:06:13 -07:00
krfricke 57c4183724 [tune] add xgboost callbacks to integration module (#10502) 2020-09-02 11:16:09 -07:00
raoul-khour-ts 3b10b67a15 [tune] SigOpt multi-objective search + experiments (#10457) 2020-09-01 16:22:29 -07:00
krfricke 1dd55f4b07 [tune] remove callbacks from config in wandb logger initialization (#10441) 2020-09-01 14:26:39 -07:00
Richard Liaw 3f98a8bfcb [docs] Fix warnings for sphinx 1.8 (#10476)
* fix-build-for-sphinx18

* jnilit
2020-09-01 13:37:35 -07:00
Richard Liaw 09d4a3241f [tune] Support true pooling and batched concurrency (#10352) 2020-09-01 10:33:49 -07:00
krfricke f3f698816d [tune] Added PyTorch Lightning callbacks to integrations (#10220)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-31 15:30:48 -07:00
Richard Liaw d8e7b144e4 [tune] avoid distributed error message (#10387) 2020-08-31 15:29:43 -07:00
Jan Blumenkamp 5774e1ce88 [tune/rllib/wandb] Flatten result dict so that nested result dicts are shown in W&B logger (#10429) 2020-08-31 15:28:46 -07:00
Sumanth Ratna bac8f14739 [tune] Use isinstance instead of type in assert in HyperOptSearch (#10454) 2020-08-31 15:26:55 -07:00
krfricke efa1d51aea [tune] Added external PyTorch tutorial test (#10192) 2020-08-31 15:24:31 -07:00
raoul-khour-ts 25f5614691 [tune] Rrk/sigopt_searcher_improvements (#10446) 2020-08-31 13:15:12 -07:00
Amog Kamsetty afde3db4f0 [Tune] Synchronous Mode for PBT (#10283) 2020-08-31 00:00:47 -07:00
Richard Liaw cb438be146 [core] Move log_to_driver back to public (#10422) 2020-08-29 16:35:14 -07:00
Eric Liang 2a204260a8 [api] Second round of 1.0 API changes: exceptions, num_return_vals (#10377) 2020-08-28 19:57:02 -07:00
Eric Liang 519354a39a [api] Initial API deprecations for Ray 1.0 (#10325) 2020-08-28 15:03:50 -07:00
Richard Liaw 0d22c0b653 [tune] Avoid recreating actor multiple times (#10374) 2020-08-27 18:02:26 -07:00
Stephanie Wang f75dfd60a3 [api] API deprecations and cleanups for 1.0 (internal_config and Checkpointable actor) (#10333)
* remove

* internal config updates, remove Checkpointable

* Lower object timeout default

* remove json

* Fix flaky test

* Fix unit test
2020-08-27 10:19:53 -07:00
Amog Kamsetty 0aec4cbccb [Tune] Update PBT Transformers Example (#10289)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: krfricke <krfricke@users.noreply.github.com>
2020-08-27 08:25:05 -07:00
krfricke 53ab228b75 [tune] Fix log to file on actor reuse (#10363) 2020-08-27 08:22:19 -07:00
Michael Luo 4e9888ce2f [RLlib] Dreamer (#10172) 2020-08-26 13:24:05 +02:00
Amog Kamsetty 8c0503ddd3 [Tune] Convert PBT DCGAN Example to Function API (#10246)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-25 22:34:19 -07:00
Antoni Baum 87ed20738e [tune] Add on_pause, on_unpause to ConcurrencyLimiter (#10320)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-25 22:33:17 -07:00
Richard Liaw 146d91385c [tune] custom trial directory name (#10214) 2020-08-25 12:52:54 -07:00
Richard Liaw 6bd5458bef [tune] cleanup error messaging/diagnose_serialization helper (#10210) 2020-08-22 11:50:49 -07:00
Richard Liaw 24ee496b89 [tune] support rerunning failed trials (#10060) 2020-08-22 09:59:05 -07:00
krfricke c31876002d [tune/rllib] made wandb compatible with rllib trainables (#10252) 2020-08-21 17:25:52 -07:00
Amog Kamsetty 8d466749ee [Tune] PBT hyperparam_mutations fix (#10217) 2020-08-20 12:02:29 -07:00
Amog Kamsetty 44e254788a [Tune] PBT hyperparam_mutations improvements (#10170) 2020-08-19 16:50:19 -07:00
Tomasz Wrona aff7f19360 [tune] Added logger_config field (#8521)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-18 11:10:22 -07:00
Amog Kamsetty d3bac298d5 [Tune] PBT Error if metric not available (#9957) 2020-08-17 16:12:14 -07:00
krfricke 8f0f7371a0 [tune] Added Kubernetes syncer and sync client (#10097)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-16 14:09:28 -07:00
Amog Kamsetty f87a4aa45d [Tune] Pbt Function API (#9958)
* adding function convnet example

* add unit test

* update test

* update example

* wip

* move error from experiment to tune

* wip

* Fix checkpoint deletion

* updating code

* adding smoke test

* updating pbt guide

* formatting

* fix build

* add best checkpoint analysis util

* update test

* add comments

* remove class api

* fix example

* add setup and teardown to tests

* formatting

* Update python/ray/tune/tests/test_trial_scheduler_pbt.py

Co-authored-by: Kai Fricke <kai@anyscale.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-14 17:52:30 -07:00
Amog Kamsetty 5898248645 [Tune] Update PBT Transformer Test (#10081) 2020-08-13 12:23:03 -07:00
krfricke 16486a8df3 [tune] Add OptunaSearcher wrapper around Optuna samplers (#10044)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-12 16:13:22 -07:00
Richard Liaw 7a8b922841 [tune] hotfix log_once (#10069) 2020-08-12 12:40:22 -07:00
Simon Mo f1ede1099f [Hotfix] Pin opencv-python-headless==4.3.0.36 (#10049) 2020-08-11 15:58:18 -07:00
krfricke 221fdc0774 [tune] fix flaky PBT replay test (#10047)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-11 14:17:31 -07:00
Richard Liaw 98df612010 [tune] option to raise on error (#10030) 2020-08-11 09:59:04 -07:00
Amog Kamsetty 856d4a0533 [Tune] Better error when using checkpoint_freq (#9998) 2020-08-10 13:52:46 -07:00