Commit Graph

2984 Commits

Author SHA1 Message Date
Ameer Haj Ali 54c616e9f3 [autoscaler] Enforce CommandRunnerInterface abstractions (#10822)
Co-authored-by: root <root@ip-172-31-28-155.us-west-2.compute.internal>
Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local>
2020-09-16 16:56:03 -07:00
SangBin Cho 1fdb7ef6c3 [docs] Placement group documentation (#10555)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-16 16:07:55 -07:00
Alex Wu 9d0a9e73de Add java yaml example (#10835)
* java example

* Update python/ray/autoscaler/aws/example-java.yaml

Co-authored-by: Eric Liang <ekhliang@gmail.com>
2020-09-16 14:35:10 -07:00
SangBin Cho d7d4e1c87b [Doc] Document options method (#10830)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-16 14:23:24 -07:00
fyrestone 50784e2496 [Dashboard] Dashboard node grouping (#10528)
* Add RAY_NODE_ID environment var to agent

* Node ralated data use node id as key

* ray.init() return node id; Pass test_reporter.py

* Fix lint & CI

* Fix comments

* Minor fixes

* Fix CI

* Add const to ClientID in AgentManager::Options

* Use fstring

* Add comments

* Fix lint

* Add test_multi_nodes_info

Co-authored-by: 刘宝 <po.lb@antfin.com>
2020-09-16 10:17:29 -07:00
Tao Wang eb891e6c94 [TEST]make retry counts (#10463)
* make retry counts

* lint

* use function

* move methond inside
2020-09-16 10:12:30 -07:00
Kai Fricke c9fafe7733 [tune] added type hints (#10806)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-15 21:03:56 -07:00
Yiran Wang c198869721 [Autoscaler] Change poll interval to 5 sec when checking VMs status (#10462) 2020-09-15 17:23:29 -07:00
Amog Kamsetty d5a7c53908 [Ray SGD] use_local flag + Worker group abstraction (#10539)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-15 11:58:57 -07:00
Kai Fricke 0865d68466 [tune] convert fallback representation to numbers in wandb integration (#10799) 2020-09-15 11:47:11 -07:00
Max Fitton 334e11c704 [Dashboard] Fix a number of console warnings caused by incorrect usage of react keys (#10749)
* Fix a number of console warnings caused by incorrect usage of react keys

* lint

* lint

Co-authored-by: Max Fitton <max@semprehealth.com>
2020-09-15 11:21:44 -07:00
Siyuan (Ryans) Zhuang c2dff126aa [Core] Warn when failed to get the exact version of pickle5 (#10731)
* warn when failed to get the exact version of pickle5

* add missing spaces
2020-09-15 11:21:27 -07:00
Ameer Haj Ali 6edacb22b8 Fix abstraction violations in command_runner interface (#10715)
* Fix abstraction violations in command_runner interface

* user guide

* lint

* breaking abstraction in commands

* extra initialization commands

* more cleanup

* small fixes

* fix test_integration_kubernetes.py

* lint

Co-authored-by: root <root@ip-172-31-28-155.us-west-2.compute.internal>
Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local>
2020-09-14 20:28:38 -07:00
Hao Chen 1a5cfe0b79 [Java] rename config ray.redis.address to ray.address (#10772) 2020-09-15 11:13:19 +08:00
Eric Liang ea3e4d622e Restore plasma directory option (#10784) 2020-09-14 19:05:55 -07:00
Richard Liaw e3fd5eceec [minor] fix warning about docker cpus (#10768) 2020-09-14 09:08:34 -07:00
Kai Yang 4c03f7ca2f [Core] Multi-tenancy: Reject worker registration if job has finished (#10569) 2020-09-14 14:49:31 +08:00
Ian Rodney 5bc2ba38fd [docker] Detect CPUs in container correctly (#10507)
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-13 23:40:48 -07:00
Richard Liaw 660aee6311 [cli] make test failure less verbose + print ssh (#10767) 2020-09-13 23:37:10 -07:00
Alex Wu 9795356ac0 [hotfix] Autoscaler's K8 support (#10766)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-13 16:43:57 -07:00
Eric Liang 00fefba72c [autoscaler] Usability improvements in logging (#10764) 2020-09-13 13:54:44 -07:00
Alex Wu d0b73647b4 [Autoscaler] Unmanaged nodes (#10513) 2020-09-13 11:58:47 -07:00
Barak Michener 9f9b53e624 Remove superfluous execution of java (#10750) 2020-09-11 19:03:38 -07:00
Ian Rodney 4659e24495 [docker] Revert to rsync & cp instead of file mount for bootstrap config/key (#10734) 2020-09-11 16:56:26 -07:00
Richard Liaw 6662efd74b [tune/rllib] revert removal of queue-trials (#10744) 2020-09-11 14:13:20 -07:00
Philipp Moritz a91073d9da Don't pin boto instead set lower limit on its version (#10711) 2020-09-11 13:22:32 -07:00
Alex Wu d2778f6fbb [hotfix] accelerator_types (#10725)
* .

* .
2020-09-11 12:43:43 -07:00
Alex Wu 1ff56765f0 [Autoscaler] Fix utilization calc (#10728) 2020-09-11 12:41:08 -07:00
Ian Rodney 13dc3b59f1 [autoscaler] Fix rsync file mounts (#10721) 2020-09-10 19:44:58 -07:00
Richard Liaw 401195d935 [cli] Remove extra wording + fix travis (#10726) 2020-09-10 19:11:04 -07:00
Eric Liang cbc52a2a42 Remove colorful from ray core (#10723) 2020-09-10 18:41:59 -07:00
Kai Fricke 7eaf063f29 [tune] wrapper function to pass arbitrary objects through the object store to trainables (#10679) 2020-09-10 17:39:44 -07:00
Ian Rodney ea6fe0f2a1 [autoscaler] use default value (#10706) 2020-09-10 17:06:56 -07:00
PidgeyBE 9d7be89973 [autoscaler] Fix ingress manifest (#10618) 2020-09-10 18:34:14 -05:00
Barak Michener c6b1ed7f8f release process: bump version number to 1.1.0.dev0 everywhere (#10686) 2020-09-10 16:00:21 -07:00
Alex Wu 12261c2a19 [Autoscaler] Cluster sync expand user (#10705)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-10 15:59:24 -07:00
Siyuan (Ryans) Zhuang fb0ae148e6 Fix typo in ray start output (#10667) 2020-09-10 15:56:23 -07:00
architkulkarni 333f324b88 Run Serve Tests on Windows (#10682) 2020-09-10 15:54:37 -07:00
Richard Liaw 7aa55ca82c [autoscaler] make commands very explicit on logs (#10713) 2020-09-10 10:47:46 -07:00
Richard Liaw eb025ea8cb [autoscaler] Create provider exactly once (#10703)
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
2020-09-10 01:03:52 -07:00
Kai Fricke 67bf396ae7 [tune] wandb log cleaning to use yaml representer (#10680)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-10 00:07:16 -07:00
Max Fitton 3e8164ff8a [Dashboard] Logical View Actor Class Grouping Details (#10453)
* wip

* wip

* wip

* wip

* Need to track the timestamp actors are created for the dashboard. This adds that functionality back in and deletes unused code

* Add the materialui lab packages to get access to the Alert component and fix up some vulnerabilities with npm audit.

* Finish supporting information on a per-actor-class basis in the logical view, add bug fixes around timestamps and infeasible task names, and add a new warning popup that shows if there are infeasible actors around.

* lint and add seconds annotation to actor lifetime values

* real lint

* remove typo

* Somehow missed something last lint

* Add new comments for actor states

* Add underscores to some private functions

* Add tooltips to the actor states on the logical view

* change test metrics to be aligned with new changes.

* lint

* Remove some unnecessary log lines and catch error that happens when we try to decode data from an unexpected source

* Re-add a function I had removed. It is used in the Java codebase.

Co-authored-by: Max Fitton <max@semprehealth.com>
2020-09-09 10:34:54 -07:00
Richard Liaw 153813936b [tune] auto infer metrics (#10663)
Co-authored-by: Kai Fricke <krfricke@users.noreply.github.com>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-09-09 09:53:47 -07:00
Richard Liaw 3501ea396c [tune] All examples to use ConcurrencyLimiter (#10662)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-09-09 09:52:15 -07:00
Alex Wu cd5b99e5e0 [hotfix] redis_password -> _redis_password (#10672) 2020-09-09 09:40:49 -07:00
Kai Yang afa0216280 Remove the '--include-java' option (#10594) 2020-09-09 17:01:17 +08:00
Hao Chen d22980a5c3 [Hotfix] fix bug about code_search_path in JobConfig (#10666) 2020-09-09 15:28:45 +08:00
Kai Fricke d7c7aba99c [tune] Tune experiment analysis improvements (#10645)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 21:00:52 -07:00
Alex Wu d9c68fca5c [Core] Logging improvements (#10625)
* other stuff
:

* lint

* .

* .

* lint

* comment

* lint

* .
2020-09-08 20:58:05 -07:00
Kai Fricke 756a9ea641 [tune] add mode/metric parameters to tune.run (#10627)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-09-08 17:06:21 -07:00