Commit Graph

927 Commits

Author SHA1 Message Date
Ameer Haj Ali 6b86d4d280 Automatically detect CPU, GPU, accelerator_type for AWS (#11147) 2020-10-02 21:16:43 -07:00
Ian Rodney 0d5b09f426 [Docker] Automagically add "runtime=nvidia" (#11125) 2020-10-01 17:04:19 -07:00
Kai Fricke 681c24754a [tune] Example for using huggingface hyperparamer_search API (#11158) 2020-10-01 16:00:57 -07:00
Kai Fricke bdf647c4ec [tune] docker syncer (#11035)
* Add DockerSyncer

* Add docs

* Update python/ray/tune/integration/docker.py

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Updated docs

* fix dir

* Added docker integration test

* added docker integration test to bazel build

* Use sdk.rsync API

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-01 11:59:23 -07:00
Sumanth Ratna 98ebf8e2d8 [tune][docs] fix typo in Tune FAQ (#11161)
* Fix typo in tune FAQ (used to use)

* Update doc/source/tune/_tutorials/_faq.rst

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-10-01 11:20:41 -07:00
Simon Mo a518fb1031 [Doc] Use different pygments_style (#11143) 2020-09-30 16:16:55 -07:00
Kai Fricke c77cfaa5ad [tune] use dated experiment dir per default (#11104) 2020-09-30 14:43:59 -07:00
Kai Fricke b8f344f695 [tune] add faq entry for reproducing experiments (setting seeds etc) (#11106) 2020-09-29 14:48:39 -07:00
architkulkarni 3ad670efa6 auto-update copyright year in docs (#11114) 2020-09-29 13:57:06 -07:00
Sven Mika f91c455527 [RLlib] Curiosity documentation. (#11066) 2020-09-29 09:39:22 +02:00
Ameer Haj Ali 0d36e4c025 [autoscaler] Support min_workers for multi node type (#11041)
* prepare for head node

* move command runner interface outside _private

* remove space

* Eric

* flake

* min_workers in multi node type

* fixing edge cases

* eric not idle

* fix target_workers to consider min_workers of node types

* idle timeout

* minor

* minor fix

* test

* lint

* eric v2

* eric 3

* min_workers constraint before bin packing

* Update resource_demand_scheduler.py

* Revert "Update resource_demand_scheduler.py"

This reverts commit 818a63a2c86d8437b3ef21c5035d701c1d1127b5.

* reducing diff

Co-authored-by: Ameer Haj Ali <ameerhajali@ameers-mbp.lan>
Co-authored-by: Alex Wu <alex@anyscale.io>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-28 22:02:01 -07:00
Kai Fricke e7315b0856 [tune] Callbacks for tune runs (#11001) 2020-09-27 16:50:07 -07:00
Christian Kasim Loan 4285bee517 [Doc] Added John Snow Lab's NLU reference to community integration page (#10985)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-27 13:07:12 -07:00
SangBin Cho 109481afd9 [Metric] custom metrics refinement (#10861)
* In progress

* In Progress.

* Addressed code review.

* Add unit tests.

* Add a simple doc.

* Fixed test failure.

* Fix all test failures from serve.

* Addressed code review.
2020-09-25 09:10:28 -07:00
Eric Liang 609c1b8acd Start moving ray internal files to _private module (#10994) 2020-09-24 22:46:35 -07:00
Richard Liaw a563344bc2 [docs] remove ref to google groups -> github discussions (#11019) 2020-09-24 18:09:51 -07:00
Kai Fricke d9c4dea7cf [tune] strict metric checking (#10972) 2020-09-24 10:00:48 -07:00
SangBin Cho 5e6b887f2d [Placement Group] Capture Child Task Part 1 (#10968)
* In progress.

* In progers.

* Done.

* Addressed code review.

* Increase timeout to make a test less flaky.

* Addressed code review.

* Addressed code review.
2020-09-24 09:02:03 -07:00
Amog Kamsetty f42ab54112 [Docs] [Tune] Fix Tune Quick Start docs (#10996) 2020-09-24 00:28:01 -07:00
Ian Rodney 4c3f09094a [docs] redis-port -> port (#10937) 2020-09-23 17:04:13 -07:00
SangBin Cho cebab8886e [Placement group] Refine doc (#10922) 2020-09-23 16:26:32 -07:00
Lee moon soo df4c3abe30 [autoscaler] Staroid node provider (#10956) 2020-09-22 21:25:29 -07:00
Simon Mo 7fbe076813 [Serve] Unwrap Flask Request from ServeHandle (#10845) 2020-09-22 12:44:23 -07:00
Simon Mo 970fc37173 [Serve] Update architecture.svg (#10754) 2020-09-22 12:43:02 -07:00
Simon Mo 3c1a7c2954 [Doc][Serve] Update middleware docs for serve.client (#10819) 2020-09-22 11:03:32 -07:00
Kai Fricke 50d63b8077 [tune] update pt tutorial docs (#10925)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-21 13:33:37 -07:00
Richard Liaw b0ca70f628 [tune+core] tune lifecycle and starting ray guide (#10813) 2020-09-21 11:27:50 -07:00
Sven Mika 805dad3bc4 [RLlib] SAC algo cleanup. (#10825) 2020-09-20 11:27:02 +02:00
Sumanth Ratna d3fa39efd6 [docs] fix version flyout menu z-index (#10892) 2020-09-19 13:30:35 -07:00
Carlos Aguayo 86b1814e62 Update rllib-env.rst (#10891)
Tiny typo
2020-09-19 00:29:56 -07:00
rkube cd7351f6a3 Streamlined slurm script and removed references to redis_password (#10827)
Co-authored-by: Ralph Kube <ralph.kube@uit.not>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-18 14:55:56 -07:00
Richard Liaw 41d7221dcd fix (#10876) 2020-09-17 23:17:39 -07:00
Kai Fricke 508cfa3540 [tune] Support yield and return statements (#10857)
* Support `yield` and `return` statements in Tune trainable functions

* Support anonymous metric with ``tune.report(value)``

* Raise on invalid return/yield value

* Fix end to end reporter test
2020-09-17 20:18:35 -07:00
SangBin Cho fedbdd5dc6 [Doc] Broken doc build fix. (#10865) 2020-09-17 13:27:30 -07:00
Benjamin Black f2408b719c Fixed PettingZooEnv (#10847) 2020-09-17 11:28:42 -07:00
Keqiu Hu 8a77cf925a [cli][ray] update ray cli message (#10823) 2020-09-17 09:26:55 -07:00
Eric Liang 89da3f9ba7 [docs] Add RayDP link to community integrations (#10851) 2020-09-17 01:21:12 -07:00
Sumanth Ratna 77c3414bc2 [docs] fix book icon in version flyout menu (#10844)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-16 19:41:14 -07:00
Richard Liaw 829a2307df [docs] raise z-index block (#10843)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Sumanth Ratna <sumanthratna@gmail.com>
2020-09-16 17:16:50 -07:00
SangBin Cho 1fdb7ef6c3 [docs] Placement group documentation (#10555)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-16 16:07:55 -07:00
SangBin Cho d7d4e1c87b [Doc] Document options method (#10830)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-16 14:23:24 -07:00
Kai Fricke c9fafe7733 [tune] added type hints (#10806)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-15 21:03:56 -07:00
Kai Yang da1d171c39 Java doc: "Configuring Ray" page (#10801) 2020-09-16 11:43:16 +08:00
Eric Liang 0d9d34a3c1 [docs] Sort library list alphabetically and add experimental note to Dask (#10815)
* sort

* update

* update
2020-09-15 17:26:09 -07:00
Eric Liang 3ec5fa1b51 [docs] Rename oss-users to ray-libraries (#10811) 2020-09-15 13:11:00 -07:00
architkulkarni 940f02913a [Docs] update docs readme and fix typo (#10807) 2020-09-15 12:51:18 -07:00
Amog Kamsetty d5a7c53908 [Ray SGD] use_local flag + Worker group abstraction (#10539)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-15 11:58:57 -07:00
Richard Liaw 1a4023387d [docs] slurm + progress_bar example (#10782) 2020-09-15 00:16:36 -07:00
Eric Liang 72b28dc12b [docs] Fix broken links in new community libraries page ++ (#10785)
* fix

* fix up

* update

* revert

* typo

* update
2020-09-14 21:18:28 -07:00
Ameer Haj Ali 6edacb22b8 Fix abstraction violations in command_runner interface (#10715)
* Fix abstraction violations in command_runner interface

* user guide

* lint

* breaking abstraction in commands

* extra initialization commands

* more cleanup

* small fixes

* fix test_integration_kubernetes.py

* lint

Co-authored-by: root <root@ip-172-31-28-155.us-west-2.compute.internal>
Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local>
2020-09-14 20:28:38 -07:00