c583113d66
[Ax] Align optimization mode and reported SEM with Ax ( #13611 )
...
* [Ax] Align optimization mode and reported SEM with Ax
Ensure that `mode` aligns with the mode set in Ax + report SEM as None rather than as 0.0 to make use of Ax noise inference
* Account for review
* Update ax.py
* Fix lint
* Fix tests, ad additional checks
* Fix tests for python 3.6
Co-authored-by: Kai Fricke <kai@anyscale.com >
2021-01-28 19:01:51 +01:00
2664a2a8f6
[tune] fix non-deterministic category sampling by switching back to np.random.choice ( #13710 )
...
* Enable zoopt tests again, but wait for next release
* Add test and preserve state in trial executor
* Add baseline check with integers
* [tune] fix non-deterministic category sampling, re-enable zoopt tests
* Remove random import
* Disable zoopt tests
2021-01-27 16:42:44 +01:00
17760e1510
[tune] update Optuna integration to 2.4.0 API ( #13631 )
...
Co-authored-by: Amog Kamsetty <amogkamsetty@yahoo.com >
2021-01-23 00:32:37 -08:00
7a2997ea8c
[tune] support experiment checkpointing for grid search ( #13357 )
2021-01-18 19:24:36 -08:00
c6fc7124d1
[tune] Fix f-string in error message ( #13423 )
2021-01-13 18:34:21 -06:00
d4b0a9fadf
[tune] convert search spaces: parse spec before flattening ( #12785 )
...
* Parse spec before flattening
* flatten after parse
* Test for ValueError if grid search is passed to search algorithms
2021-01-09 18:21:49 +01:00
a4f2dd2138
[Tune]Add integer loguniform support ( #12994 )
...
* Add integer quantization and loguniform support
* Fix hyperopt qloguniform not being np.log'd first
* Add tests, __init__
* Try to fix tests, better exceptions
* Tweak docstrings
* Type checks in SearchSpaceTest
* Update docs
* Lint, tests
* Update doc/source/tune/api_docs/search_space.rst
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com >
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com >
2020-12-23 09:27:16 -08:00
038a50af52
[tune] skopt fix-extra-import ( #12970 )
...
Signed-off-by: Richard Liaw <rliaw@berkeley.edu >
2020-12-20 01:01:09 -08:00
55ae567f7a
[tune] Fix and enable SigOpt tests ( #12877 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-12-18 01:33:12 -08:00
3d72000826
[tune] Add points_to_evaluate to BasicVariantGenerator ( #12916 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-12-17 19:16:03 -08:00
ea1228074d
[tune] enable points_to_eval for all search algorithms ( #12790 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-12-15 11:51:53 -08:00
42c70be073
[tune] Hyperopt: Directly accept category variables instead of indices ( #12715 )
...
* [tune] Hyperopt: Directly accept category variables instead of indices
* Fix interrupt test
* Update python/ray/tune/suggest/hyperopt.py
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
* Apply suggestions from code review
* Update python/ray/tune/suggest/hyperopt.py
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
* lint
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-12-12 01:40:53 -08:00
7422abddb4
[tune] trim kwargs in shim instantiation functions ( #12544 )
2020-12-02 12:07:00 -08:00
b94bfdfa99
[tune] use default anonymous metric _metric if at least a mode is set ( #12159 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-11-23 20:09:33 -08:00
4c4f189f97
[tune] nevergrad add points_to_evaluate ( #12207 )
2020-11-23 12:51:04 -08:00
643c07e451
[tune] update param & install hints for Search Algos ( #12242 )
...
* fix(tune): change objective_name param to metric for AxSearch
* fix(tune): install hints for search algos
2020-11-22 15:39:41 -08:00
6999075c75
[tune] Add seed parameter to BOHB ( #12160 )
2020-11-19 10:27:16 -08:00
02c02369ca
[tune] Fix hpo randint limits ( #11946 )
...
Co-authored-by: Sumanth Ratna <sumanthratna@gmail.com >
2020-11-12 08:45:49 -08:00
88be1ea20b
[tune] Handle infinite and NaN values ( #11835 )
2020-11-09 11:18:31 -08:00
ba63ded311
[tune] better error when metric or mode unset in search algorithms ( #11646 )
2020-10-28 13:17:59 -07:00
1a1ff28d18
[tune] allow tune search spaces to be passed to search algorithms ( #11503 )
2020-10-26 12:33:13 -07:00
aeea168940
[tune] Update for ZOOpt ( #11491 )
...
Co-authored-by: Servon <zewen.li@polixir.ai >
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-10-20 23:56:20 -07:00
ed81010b0d
[tune] support hierarchical search spaces for hyperopt ( #11431 )
...
* support hierarchical search spaces for hyperopt
* Reduce num samples
* Fix prefix
2020-10-19 16:00:08 -07:00
202b1859ef
[tune] Update ZOOpt to better support the latest Ray ( #11462 )
...
Co-authored-by: Servon <zewen.li@polixir.ai >
2020-10-19 09:28:11 -07:00
60a4be4a59
[tune] Remove metric and mode kwargs from create_searcher ( #11335 )
2020-10-14 21:44:36 -07:00
3fe757391b
[tune] Add Basic Variant Generator to search algorithm shim function ( #11334 )
...
* Add Basic Variant Generator
* Add 'random' key to SEARCH_ALG_IMPORT
Co-authored-by: Kai Fricke <kai@anyscale.com >
Co-authored-by: Kai Fricke <kai@anyscale.com >
2020-10-14 21:41:47 -07:00
c77cfaa5ad
[tune] use dated experiment dir per default ( #11104 )
2020-09-30 14:43:59 -07:00
d9c4dea7cf
[tune] strict metric checking ( #10972 )
2020-09-24 10:00:48 -07:00
ee99c919e3
[tune] lazy trials ( #10802 )
...
* Lazily fill trial queue
* Update interface
* Update end to end reporter test
* Removed `next_trials()` method
* Lint
* Print total number of samples to be generated in progress reporter. Allow infinite samples.
* Nit check
2020-09-17 08:51:46 -07:00
c9fafe7733
[tune] added type hints ( #10806 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-09-15 21:03:56 -07:00
3501ea396c
[tune] All examples to use ConcurrencyLimiter ( #10662 )
...
Co-authored-by: Kai Fricke <kai@anyscale.com >
2020-09-09 09:52:15 -07:00
d7c7aba99c
[tune] Tune experiment analysis improvements ( #10645 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-09-08 21:00:52 -07:00
756a9ea641
[tune] add mode/metric parameters to tune.run ( #10627 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-09-08 17:06:21 -07:00
088f8ebb69
[tune] Add algorithms for search space conversion ( #10621 )
2020-09-07 13:44:16 -07:00
54215ff287
[tune] implement shim instantiation ( #10456 )
...
* Create ray.tune.suggest.create.create_scheduler
* Update __init__.py
* Resolve conflict in __init__.py
* Create ray.tune.schedulers.create.create_scheduler
* Update __init__.py
* Move create_scheduler to tune.schedulers.__init__
* Move create_searcher to tune.suggest.__init__
* Delete tune.suggest.create
* Delete tune.schedulers.create
* Update imports for shim functions in tune.__init__
* Remove shim from tune.suggest.__init__.__all__
* Remove shim from tune.schedulers.__init__.__all__
* Add ShimCreationTest
* Move ShimCreationTest to test_api
* Delete test_shim.py
* Add docstring for ray.tune.create_scheduler
* Add docstring to ray.tune.create_searcher
* Fix typo in ray.tune.create_scheduler docstring
* Fix lint errors in tune.schedulers.__init__
* Fix lint errors in tune.suggest.__init__
* Fix lint errors in tune.suggest.__init__
* Fix lint errors in tune.schedulers.__init__
* Fix imports in test_api
* Fix lint errors in test_api
* Fix kwargs in create_searcher
* Fix kwargs in create_scheduler
* Merge branch 'master' into shim-instantiation
* Update use-case in docs in tune.create_scheduler
* Update use-case in docs in tune.create_searcher
* Remove duplicate pytest run from test_api
* Add check to create_searcher
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
* Add check to create_scheduler
* lint
* Compare types of instances in test_api
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
* Add tune.create_searcher to docs
* Fix doc build
* Fix tests
* Add tune.create_scheduler to docs
* Fix tests
* Fix lint errors
* Update Ax search for master
* Fix metric kwarg for Ax in test_api
* Fix doc build
* Fix HyperOptSearch import in test_api
* Fix HyperOptSearch import in create_searcher
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-09-05 09:36:42 -07:00
2fac66650d
[tune] extend search space api docs ( #10576 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-09-04 18:39:51 -07:00
06af62ba91
[tune] refactor tune search space ( #10444 )
...
* Added basic functionality and tests
* Feature parity with old tune search space config
* Convert Optuna search spaces
* Introduced quantized values
* Updated Optuna resolving
* Added HyperOpt search space conversion
* Convert search spaces to AxSearch
* Convert search spaces to BayesOpt
* Added basic functionality and tests
* Feature parity with old tune search space config
* Convert Optuna search spaces
* Introduced quantized values
* Updated Optuna resolving
* Added HyperOpt search space conversion
* Convert search spaces to AxSearch
* Convert search spaces to BayesOpt
* Re-factored samplers into domain classes
* Re-added base classes
* Re-factored into list comprehensions
* Added `from_config` classmethod for config conversion
* Applied suggestions from code review
* Removed truncated normal distribution
* Set search properties in tune.run
* Added test for tune.run search properties
* Move sampler initializers to base classes
* Add tune API sampling test, fixed includes, fixed resampling bug
* Add to API docs
* Fix docs
* Update metric and mode only when set. Set default metric and mode to experiment analysis object.
* Fix experiment analysis tests
* Raise error when delimiter is used in the config keys
* Added randint/qrandint to API docs, added additional check in tune.run
* Fix tests
* Fix linting error
* Applied suggestions from code review. Re-aded tune.function for the time being
* Fix sampling tests
* Fix experiment analysis tests
* Fix tests and linting error
* Removed unnecessary default_config attribute from OptunaSearch
* Revert to set AxSearch default metric
* fix-min-max
* fix
* nits
* Added function check, enhanced loguniform error message
* fix-print
* fix
* fix
* Raise if unresolved values are in config and search space is already set
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-09-03 09:06:13 -07:00
3b10b67a15
[tune] SigOpt multi-objective search + experiments ( #10457 )
2020-09-01 16:22:29 -07:00
09d4a3241f
[tune] Support true pooling and batched concurrency ( #10352 )
2020-09-01 10:33:49 -07:00
bac8f14739
[tune] Use isinstance instead of type in assert in HyperOptSearch ( #10454 )
2020-08-31 15:26:55 -07:00
25f5614691
[tune] Rrk/sigopt_searcher_improvements ( #10446 )
2020-08-31 13:15:12 -07:00
87ed20738e
[tune] Add on_pause, on_unpause to ConcurrencyLimiter ( #10320 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-08-25 22:33:17 -07:00
146d91385c
[tune] custom trial directory name ( #10214 )
2020-08-25 12:52:54 -07:00
16486a8df3
[tune] Add OptunaSearcher wrapper around Optuna samplers ( #10044 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
Co-authored-by: Kai Fricke <kai@anyscale.com >
2020-08-12 16:13:22 -07:00
7a8b922841
[tune] hotfix log_once ( #10069 )
2020-08-12 12:40:22 -07:00
be8e63d477
[tune] support resume for search algorithms ( #9972 )
2020-08-10 13:43:14 -07:00
c6404e8cf6
[tune] Search alg checkpointing during training ( #9803 )
...
Co-authored-by: krfricke <krfricke@users.noreply.github.com >
2020-08-03 15:07:31 -07:00
6c49c01837
[tune] Function API checkpointing ( #8471 )
...
Co-authored-by: krfricke <krfricke@users.noreply.github.com >
2020-06-15 10:42:54 -07:00
19cc1ae781
[docs] Tune Search: Wrong parameter name ( #8927 )
2020-06-13 18:01:22 -07:00
57212254e6
Fix dragonfly install instructions ( #8866 )
2020-06-09 13:05:04 -07:00
Lena Kashtelyan