Commit Graph
50 Commits
Author SHA1 Message Date
Amog KamsettyandRichard Liaw 4c63917439 [Queue] Add options and shutdown to Queue (#12932)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-12-20 00:42:21 -08:00
Amog Kamsetty 51139ed37c [SGD] Fix process group timeout units (#12477) 2020-12-19 21:46:33 -08:00
5d3c9c8861 [Tune] Mlflow Integration (#12840)
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-12-19 00:40:02 -08:00
Amog Kamsetty dd522a71a1 [SGD] Disable Elastic Training by default when using with Tune (#12927) 2020-12-16 15:37:44 -08:00
Amog Kamsetty 16ca748454 [CI] Use legacy resolver for some pip imports (#12517) 2020-11-30 21:18:21 -08:00
Amog Kamsetty f9a99f20dd Revert "Re-Revert "[Core] zero-copy serializer for pytorch (#12344)" (#12478)" (#12515)
This reverts commit 3f22448834.
2020-11-30 19:05:55 -08:00
Amog KamsettyandRichard Liaw 8a406e1f9a [SGD] Add PTL Docs (#12440)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-11-28 10:09:38 -08:00
Amog Kamsetty e0573df337 [CI] Fix windows build (#12415)
* attempt to fix windows

* fix syntax

* try again

* try again

* try again

* Revert "[ray_client] Support calling functions from other functions and correct the tests (#12141)"

This reverts commit 4066056a0d.

* Revert

* Revert "Revert "[ray_client] Support calling functions from other functions and correct the tests (#12141)""

This reverts commit bb27b87b6c8d780ad796f4d4aeaa20113c8eca79.

* please work

* works

* fix
2020-11-26 10:52:11 -08:00
Amog Kamsetty f10cef93c7 [sgd] support operator.device (#12056) 2020-11-16 21:44:27 -08:00
Amog Kamsetty 900a48c19c [Tune] Better warnings/exceptions for fail_fast='raise' (#11842) 2020-11-06 15:01:55 -08:00
Amog Kamsetty 92718de40c [SGD] Better support for custom DDP (#11771) 2020-11-04 13:58:51 -08:00
Amog Kamsetty 7248d5f4ae Revert "[tune] PB2 (#11466)" (#11795)
This reverts commit e7aafd7d24.
2020-11-03 21:05:00 -08:00
Amog Kamsetty d87c186721 [RaySGD] Docs for SGD+Tune usage (#11479) 2020-10-22 13:32:27 -07:00
Amog KamsettyandRichard Liaw 38eb61442b [SGD] Callback API for SGD+Tune (#11316)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-15 15:22:14 -07:00
Amog Kamsetty 933cf6675c [Tune] Changes for Pytorch Lightning 1.0 (#11375) 2020-10-13 15:50:11 -07:00
Amog Kamsetty 1027bfd4b8 [Tune, Ray SGD] Update PTL integrations (#11271) 2020-10-08 13:43:07 -07:00
Amog Kamsetty 3b76def2d2 [Docs] [Tune] Add NeuroCard to open source projects using Tune (#11213) 2020-10-06 14:22:32 -07:00
Amog Kamsetty 6325a973a2 [Ray SGD] Support num_steps continue training (#11142) 2020-10-02 23:43:26 -07:00
Amog KamsettyandRichard Liaw 874da9a25f [Ray SGD] LightningModule integration + MNIST Example (#11042)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-01 20:07:32 -07:00
Amog KamsettyandRichard Liaw ee85cb31a5 [Tune] Fix Memory Leak (#10989)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-24 20:26:55 -07:00
Amog Kamsetty 3716fb1ca9 [Ray SGD] Fix hotfix test (#11015) 2020-09-24 14:14:03 -07:00
Amog Kamsetty 07bdf062b9 [Ray SGD] [Hotfix] Worker group hotfix (#11008) 2020-09-24 12:21:30 -07:00
Amog Kamsetty f42ab54112 [Docs] [Tune] Fix Tune Quick Start docs (#10996) 2020-09-24 00:28:01 -07:00
Amog Kamsetty 52e1495e30 [Ray SGD] TorchTrainable pre 0.8.7 deprecation warning (#10984)
* torch trainable add pre 0.8.7 backwards compat

* raise instead

* Update python/ray/util/sgd/torch/torch_trainer.py
2020-09-23 18:19:43 -07:00
Amog Kamsetty 7dbd0ff824 fix example (#10964) 2020-09-23 10:33:19 -07:00
Amog Kamsetty 4872ffb44c [Tune] Upgrade Tune tests to TF v2.2 (#10963) 2020-09-22 18:30:05 -07:00
Amog Kamsetty d1d4743702 [Ray SGD] FP16 Hotfix (#10931) 2020-09-21 13:10:10 -07:00
Amog KamsettyandRichard Liaw d5a7c53908 [Ray SGD] use_local flag + Worker group abstraction (#10539)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-15 11:58:57 -07:00
Amog KamsettyandRichard Liaw 415be78cc0 [RaySGD] Simplify Builder Process (#10321)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 15:19:40 -07:00
Amog Kamsetty afde3db4f0 [Tune] Synchronous Mode for PBT (#10283) 2020-08-31 00:00:47 -07:00
0aec4cbccb [Tune] Update PBT Transformers Example (#10289)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: krfricke <krfricke@users.noreply.github.com>
2020-08-27 08:25:05 -07:00
Amog KamsettyandRichard Liaw 8c0503ddd3 [Tune] Convert PBT DCGAN Example to Function API (#10246)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-25 22:34:19 -07:00
Amog Kamsetty 8d466749ee [Tune] PBT hyperparam_mutations fix (#10217) 2020-08-20 12:02:29 -07:00
Amog Kamsetty 9ff687c093 [SGD][Docs] docs for training/ validation results (#10181) 2020-08-19 17:22:28 -07:00
Amog Kamsetty 44e254788a [Tune] PBT hyperparam_mutations improvements (#10170) 2020-08-19 16:50:19 -07:00
Amog Kamsetty d3bac298d5 [Tune] PBT Error if metric not available (#9957) 2020-08-17 16:12:14 -07:00
f87a4aa45d [Tune] Pbt Function API (#9958)
* adding function convnet example

* add unit test

* update test

* update example

* wip

* move error from experiment to tune

* wip

* Fix checkpoint deletion

* updating code

* adding smoke test

* updating pbt guide

* formatting

* fix build

* add best checkpoint analysis util

* update test

* add comments

* remove class api

* fix example

* add setup and teardown to tests

* formatting

* Update python/ray/tune/tests/test_trial_scheduler_pbt.py

Co-authored-by: Kai Fricke <kai@anyscale.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-14 17:52:30 -07:00
Amog Kamsetty 5898248645 [Tune] Update PBT Transformer Test (#10081) 2020-08-13 12:23:03 -07:00
Amog Kamsetty 4f8fef134e [Tune] Remove checkpoint_at_end from tune+serve docs (#10034) 2020-08-11 09:05:57 -07:00
Amog Kamsetty 856d4a0533 [Tune] Better error when using checkpoint_freq (#9998) 2020-08-10 13:52:46 -07:00
Amog KamsettyandKai Fricke 5af7d24f66 [Tune] Transformer blog example (#9789)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-04 22:05:01 -07:00
Amog Kamsetty 03709d67cb [Tune Docs] Logging doc fix (#9691) 2020-07-24 11:20:52 -07:00
Amog Kamsetty 4454d05bcf [Tune] Trainable documentation fix (#9448) 2020-07-13 13:15:01 -07:00
Amog Kamsetty 649a08926d Fix link to serve (#9109) 2020-06-23 16:06:24 -05:00
Amog Kamsetty f95ab4f506 [Testing] Multi-node Training+Tune Long Running Test (#8966) 2020-06-22 14:49:16 -07:00
Amog Kamsetty 9410e5884d [Tune] Parametrize Cloud Syncing Frequency (#8771) 2020-06-04 18:55:50 -07:00
Amog Kamsetty ae2e1f0883 [Parallel Iterators] Batching + Pipelining optimizations (#7931)
* batching + get_shard pipelining

* duplicate fix

* formatting

* adding performance benchmark

* minor changes

* turn batching off by default
2020-05-26 00:37:57 -07:00
Amog Kamsetty 1737a113be [Parallel Iterators] Repartition functionality (#7163)
* repartition and tests

* blacklist lib/ files from import checks

* addressing comments and splitting up tests

* code readability

* adding explicit ref for parent iterator

* formatting
2020-02-21 13:20:18 -08:00
Amog Kamsetty c8bf0715a6 [Parallel Iterator] Local Shuffle (#6921)
* adding local shuffle and corresponding tests

* fix quotes

* addressing comments and adding seed argument

* formatting

* fix formatting issues

* change test size from small to medium

* addressing comments
2020-01-30 12:27:38 -08:00
Amog Kamsetty 11d90d6d0c Change files tested in Travis by changing git diff from 2-dot to 3-dot (#6960). 2020-01-30 09:26:44 -08:00