Commit Graph
703 Commits
Author SHA1 Message Date
6b6780a108 [tune] Allow trials to remain paused in BOHB (#10531)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-04 15:29:33 -07:00
Kai FrickeandGitHub 2e49e22f21 [tune] Add test_sample to bazel BUILD (#10566) 2020-09-04 09:09:02 -07:00
Kai FrickeandGitHub 5c3d4a6670 [tune] added MXNet integration callbacks (#10533) 2020-09-03 18:06:44 -07:00
Richard LiawandGitHub 43a7a64b30 [tune] horovod trainable (#10304) 2020-09-03 16:53:35 -07:00
krfrickeandGitHub 91535e9102 [tune] Refactored Keras integration callbacks (#10509) 2020-09-03 10:16:08 -07:00
06af62ba91 [tune] refactor tune search space (#10444)
* Added basic functionality and tests

* Feature parity with old tune search space config

* Convert Optuna search spaces

* Introduced quantized values

* Updated Optuna resolving

* Added HyperOpt search space conversion

* Convert search spaces to AxSearch

* Convert search spaces to BayesOpt

* Added basic functionality and tests

* Feature parity with old tune search space config

* Convert Optuna search spaces

* Introduced quantized values

* Updated Optuna resolving

* Added HyperOpt search space conversion

* Convert search spaces to AxSearch

* Convert search spaces to BayesOpt

* Re-factored samplers into domain classes

* Re-added base classes

* Re-factored into list comprehensions

* Added `from_config` classmethod for config conversion

* Applied suggestions from code review

* Removed truncated normal distribution

* Set search properties in tune.run

* Added test for tune.run search properties

* Move sampler initializers to base classes

* Add tune API sampling test, fixed includes, fixed resampling bug

* Add to API docs

* Fix docs

* Update metric and mode only when set. Set default metric and mode to experiment analysis object.

* Fix experiment analysis tests

* Raise error when delimiter is used in the config keys

* Added randint/qrandint to API docs, added additional check in tune.run

* Fix tests

* Fix linting error

* Applied suggestions from code review. Re-aded tune.function for the time being

* Fix sampling tests

* Fix experiment analysis tests

* Fix tests and linting error

* Removed unnecessary default_config attribute from OptunaSearch

* Revert to set AxSearch default metric

* fix-min-max

* fix

* nits

* Added function check, enhanced loguniform error message

* fix-print

* fix

* fix

* Raise if unresolved values are in config and search space is already set

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-03 09:06:13 -07:00
krfrickeandGitHub 57c4183724 [tune] add xgboost callbacks to integration module (#10502) 2020-09-02 11:16:09 -07:00
raoul-khour-tsandGitHub 3b10b67a15 [tune] SigOpt multi-objective search + experiments (#10457) 2020-09-01 16:22:29 -07:00
krfrickeandGitHub 1dd55f4b07 [tune] remove callbacks from config in wandb logger initialization (#10441) 2020-09-01 14:26:39 -07:00
Richard LiawandGitHub 3f98a8bfcb [docs] Fix warnings for sphinx 1.8 (#10476)
* fix-build-for-sphinx18

* jnilit
2020-09-01 13:37:35 -07:00
Richard LiawandGitHub 09d4a3241f [tune] Support true pooling and batched concurrency (#10352) 2020-09-01 10:33:49 -07:00
f3f698816d [tune] Added PyTorch Lightning callbacks to integrations (#10220)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-31 15:30:48 -07:00
Richard LiawandGitHub d8e7b144e4 [tune] avoid distributed error message (#10387) 2020-08-31 15:29:43 -07:00
Jan BlumenkampandGitHub 5774e1ce88 [tune/rllib/wandb] Flatten result dict so that nested result dicts are shown in W&B logger (#10429) 2020-08-31 15:28:46 -07:00
Sumanth RatnaandGitHub bac8f14739 [tune] Use isinstance instead of type in assert in HyperOptSearch (#10454) 2020-08-31 15:26:55 -07:00
krfrickeandGitHub efa1d51aea [tune] Added external PyTorch tutorial test (#10192) 2020-08-31 15:24:31 -07:00
raoul-khour-tsandGitHub 25f5614691 [tune] Rrk/sigopt_searcher_improvements (#10446) 2020-08-31 13:15:12 -07:00
Amog KamsettyandGitHub afde3db4f0 [Tune] Synchronous Mode for PBT (#10283) 2020-08-31 00:00:47 -07:00
Richard LiawandGitHub cb438be146 [core] Move log_to_driver back to public (#10422) 2020-08-29 16:35:14 -07:00
Eric LiangandGitHub 2a204260a8 [api] Second round of 1.0 API changes: exceptions, num_return_vals (#10377) 2020-08-28 19:57:02 -07:00
Eric LiangandGitHub 519354a39a [api] Initial API deprecations for Ray 1.0 (#10325) 2020-08-28 15:03:50 -07:00
Richard LiawandGitHub 0d22c0b653 [tune] Avoid recreating actor multiple times (#10374) 2020-08-27 18:02:26 -07:00
Stephanie WangandGitHub f75dfd60a3 [api] API deprecations and cleanups for 1.0 (internal_config and Checkpointable actor) (#10333)
* remove

* internal config updates, remove Checkpointable

* Lower object timeout default

* remove json

* Fix flaky test

* Fix unit test
2020-08-27 10:19:53 -07:00
0aec4cbccb [Tune] Update PBT Transformers Example (#10289)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: krfricke <krfricke@users.noreply.github.com>
2020-08-27 08:25:05 -07:00
krfrickeandGitHub 53ab228b75 [tune] Fix log to file on actor reuse (#10363) 2020-08-27 08:22:19 -07:00
Michael LuoandGitHub 4e9888ce2f [RLlib] Dreamer (#10172) 2020-08-26 13:24:05 +02:00
8c0503ddd3 [Tune] Convert PBT DCGAN Example to Function API (#10246)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-25 22:34:19 -07:00
87ed20738e [tune] Add on_pause, on_unpause to ConcurrencyLimiter (#10320)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-25 22:33:17 -07:00
Richard LiawandGitHub 146d91385c [tune] custom trial directory name (#10214) 2020-08-25 12:52:54 -07:00
Richard LiawandGitHub 6bd5458bef [tune] cleanup error messaging/diagnose_serialization helper (#10210) 2020-08-22 11:50:49 -07:00
Richard LiawandGitHub 24ee496b89 [tune] support rerunning failed trials (#10060) 2020-08-22 09:59:05 -07:00
krfrickeandGitHub c31876002d [tune/rllib] made wandb compatible with rllib trainables (#10252) 2020-08-21 17:25:52 -07:00
Amog KamsettyandGitHub 8d466749ee [Tune] PBT hyperparam_mutations fix (#10217) 2020-08-20 12:02:29 -07:00
Amog KamsettyandGitHub 44e254788a [Tune] PBT hyperparam_mutations improvements (#10170) 2020-08-19 16:50:19 -07:00
aff7f19360 [tune] Added logger_config field (#8521)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-18 11:10:22 -07:00
Amog KamsettyandGitHub d3bac298d5 [Tune] PBT Error if metric not available (#9957) 2020-08-17 16:12:14 -07:00
8f0f7371a0 [tune] Added Kubernetes syncer and sync client (#10097)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-16 14:09:28 -07:00
f87a4aa45d [Tune] Pbt Function API (#9958)
* adding function convnet example

* add unit test

* update test

* update example

* wip

* move error from experiment to tune

* wip

* Fix checkpoint deletion

* updating code

* adding smoke test

* updating pbt guide

* formatting

* fix build

* add best checkpoint analysis util

* update test

* add comments

* remove class api

* fix example

* add setup and teardown to tests

* formatting

* Update python/ray/tune/tests/test_trial_scheduler_pbt.py

Co-authored-by: Kai Fricke <kai@anyscale.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-14 17:52:30 -07:00
Amog KamsettyandGitHub 5898248645 [Tune] Update PBT Transformer Test (#10081) 2020-08-13 12:23:03 -07:00
16486a8df3 [tune] Add OptunaSearcher wrapper around Optuna samplers (#10044)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-12 16:13:22 -07:00
Richard LiawandGitHub 7a8b922841 [tune] hotfix log_once (#10069) 2020-08-12 12:40:22 -07:00
Simon MoandGitHub f1ede1099f [Hotfix] Pin opencv-python-headless==4.3.0.36 (#10049) 2020-08-11 15:58:18 -07:00
221fdc0774 [tune] fix flaky PBT replay test (#10047)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-11 14:17:31 -07:00
Richard LiawandGitHub 98df612010 [tune] option to raise on error (#10030) 2020-08-11 09:59:04 -07:00
Amog KamsettyandGitHub 856d4a0533 [Tune] Better error when using checkpoint_freq (#9998) 2020-08-10 13:52:46 -07:00
Richard LiawandGitHub be8e63d477 [tune] support resume for search algorithms (#9972) 2020-08-10 13:43:14 -07:00
7301733a1f [tune] Close logfile contexts (#10026)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-10 12:40:40 -07:00
a438cbd1e8 [tune] reorder transformer example save (#9994)
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-08-07 20:29:04 -07:00
0ef8224446 [tune] PBT replay utility scheduler (#9953)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-07 12:41:49 -07:00
5af7d24f66 [Tune] Transformer blog example (#9789)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-04 22:05:01 -07:00