Commit Graph

6812 Commits

Author SHA1 Message Date
Basasuya 0400a88bf1 [EVENT] Basic Function and Definition (#9657) 2020-08-11 17:36:07 +08:00
Simon Mo 65848201c3 Hotfix travis deploy step for bazel log uploads (#10032) 2020-08-10 20:50:50 -07:00
Kai Yang 3bc17fa62a [Core] Multi-tenancy: Pass env variables from job config to worker processes (#10022) 2020-08-10 14:31:37 -07:00
Simon Mo df676bc9aa Upload bazel test logs to S3 (#9884) 2020-08-10 14:26:31 -07:00
Amog Kamsetty 856d4a0533 [Tune] Better error when using checkpoint_freq (#9998) 2020-08-10 13:52:46 -07:00
Richard Liaw be8e63d477 [tune] support resume for search algorithms (#9972) 2020-08-10 13:43:14 -07:00
mehrdadn 5331c30e35 Improve Clang-IWYU to automatically make #include fixes (#9858)
Co-authored-by: Mehrdad <noreply@github.com>
2020-08-10 12:49:58 -07:00
krfricke 7301733a1f [tune] Close logfile contexts (#10026)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-10 12:40:40 -07:00
PidgeyBE 6ad2fc4831 [autoscaler] Service and Ingress per worker pod (#9359) 2020-08-10 14:13:52 -05:00
Alex Wu 2ebf76c7a3 [New Scheduler] Additional unit tests (#9990) 2020-08-10 11:44:06 -07:00
Sven Mika 4b10bdf8fc [RLlib] rollout.py - Add multi-agent test case. (#9981) 2020-08-10 19:44:23 +02:00
SangBin Cho 10baecb8c2 Try to fix. (#10005) 2020-08-10 10:05:43 -07:00
SangBin Cho eb6b10221e Increase the num of trials to reduce the probability of failing sample_test (#10007) 2020-08-10 10:05:33 -07:00
Maksim Smolin 0392bb7a72 [Autoscaler] Command Output Improvement (#9699)
* cross-platform prototype

* checkpoint

* Address PR comments

* format

* prepare to push

* format

* PR comments

* fixes

* fixtest

* Revert "fixtest"

This reverts commit d6f54353e1b891c784417bb8d0304c18cc5bcdd8.

* return-result

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-10 09:49:24 -07:00
Kai Yang 37821f0b4c Support unlimited JVM options (#9910) 2020-08-10 16:08:33 +08:00
Ian Rodney 7b87da7f03 Properly call mkdir on rsync (#9995) 2020-08-09 21:31:28 -07:00
fangfengbin 26b36a1982 Optimize node register&worker failure log (#9833) 2020-08-10 11:41:45 +08:00
fangfengbin a2bfdcbf24 [Placement Group]Trigger placement group scheduling when a new node is added (#9905) 2020-08-10 10:56:17 +08:00
qicosmos 83e4501cf6 Update com_github_nelhage_rules_boost version in ray_deps_setup.bzl (#9975)
support boost.dll
2020-08-10 10:34:48 +08:00
Alan Guo 646835d292 [autoscaler] Throw error with missing cluster_synced_files. (#9965)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-07 23:07:09 -07:00
Richard Liaw 328b450cde [tune] fix testing for serve-tune test breaking (#9993) 2020-08-07 23:05:18 -07:00
SangBin Cho 39088ab6f2 [Stats] Metrics Export User Interface Part 2 (Prometheus Service Discovery) (#9970)
* In progress.

* In Progress.

* Finish the working version.

* Write a documentation.

* Addressed code review.

* Fix lint error.

* Lint.

* Addressed code review. Make test less flaky.

* Use a random port for ray start.

* Modify doc.

* Make write atomic.
2020-08-07 21:59:24 -07:00
Richard Liaw d3cde16163 hotfix (#9996) 2020-08-07 21:44:10 -07:00
Max Fitton d9822e04d4 [Dashboard] Switch to using the correct actor ID as a react key for each actor entry in the actors list in the logical view. This fixes a bug where duplicate actor entries were being rendered in the UI (#9991)
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-07 20:46:06 -07:00
Richard Liaw a438cbd1e8 [tune] reorder transformer example save (#9994)
Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-08-07 20:29:04 -07:00
Barak Michener 8e76796fd0 ci: Redo format.sh --all script & backfill lint fixes (#9956) 2020-08-07 16:49:49 -07:00
Barak Michener 1d01c668f0 rpc: Core Worker client pool (#9934) 2020-08-07 16:34:29 -07:00
krfricke dee3322ab0 [tune] Ray Tune + Serve end-to-end integration example (#9908)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-07 15:32:49 -07:00
Alex Wu a54d3a1cee [Autoscaler] Run resource demand scheduler in CI (#9945)
* .

* .
2020-08-07 13:30:39 -07:00
Edward Oakes ca37accc07 [serve] Add min and max limits to autoscaling (#9955) 2020-08-07 15:30:14 -05:00
krfricke 0ef8224446 [tune] PBT replay utility scheduler (#9953)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-07 12:41:49 -07:00
SangBin Cho 326a470bc2 [Test] Reduce the wait for condition timeout. (#9971) 2020-08-07 11:44:53 -07:00
Tao Wang 8bea875673 [TEST]Check if port is free before start up redis (#9974)
* [TEST]Check if port is free before start up redis

* per comment
2020-08-07 10:15:12 -07:00
SangBin Cho 22934619df [Release] Fix release tests (#9976)
* In Progress.

* Fix torch version.

* Fix asan run.sh

* Addressed code review.
2020-08-07 10:06:13 -07:00
Sven Mika 5d5643e633 [RLlib] Add informative error message when bad Conv2D stack is used with fixed num_outputs (no flattening at end). (#9966) 2020-08-07 12:04:17 +02:00
Alex Wu 84b7240c4b [Core] Read resources from an environment variable (#9831) 2020-08-06 18:32:01 -07:00
Eric Liang 668f555755 [rllib] Clean up outdated docs #9915 2020-08-06 18:29:04 -07:00
Richard Liaw b91c9ba085 [k8s] fix import for commandrunner (#9968) 2020-08-06 17:30:06 -07:00
SangBin Cho 44826878ff [Core] Remove Legacy Raylet Code (#9936)
* Remove a flag and some methods in node manager including HandleDisconnectedActor, ResubmitTask, and HandleTaskReconstruction

* Make actor creator always required + remove raylet transport

* Remove actor reporter + remove FinishAssignedActorCreationTask

* Remove actor tasks.

* Remove finishactortask and switched it to finishactorcreation task

* Remove reconstruction policy.

* Remove lineage cache.

* Formatting.

* Remove actor frontier code.

* Removed build error.

* Revert "Remove reconstruction policy."

This reverts commit 9d25c9bced4da5fbcac5d484d51013345f16513b.

* Recover HandleReconstruction to mark expired objects as failed.
2020-08-06 16:37:50 -07:00
SangBin Cho ec2f1a225e [Stats] Metrics Export User Interface Part 1 (#9913)
* Metrics export port expose done.

* Support exposing metrics port + metrics agent service discovery through ray.nodes()

* Formatting.

* Added a doc.

* Linting.

* Change the location of metrics agent port.

* Addressed code review.

* Addressed code review.
2020-08-06 16:16:29 -07:00
Maksim Smolin eace94d2dc [cli] Fix issues with logging unescaped strings (#9960) 2020-08-06 14:44:39 -07:00
Max Fitton fc9fc342cf Make dashboard disk stat not break on non-Unix machines (note it will not correctly report stat still) (#9962)
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-06 15:00:26 -05:00
Max Fitton 3f7eb64063 The required resources field is not always present, leading the logical view to crash when it is not present. (#9959)
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-06 14:59:52 -05:00
Simon Mo c8da5555ab [Serve] Add preliminary middleware support (#9940) 2020-08-06 12:49:31 -07:00
Barak Michener 21994c594b python/test: Faster tests and better BUILD (#9791) 2020-08-06 10:58:42 -07:00
Max Fitton 6a1acce791 [Dashboard] Fix Bug in Machine View when Unsorted with Multiple Machines (#9938)
* Patch issue where when the Machine view was unsorted and grouped, it would crash.

* lint

Co-authored-by: Max Fitton <max@semprehealth.com>
2020-08-06 10:38:01 -07:00
Sven Mika 57690a3a9f [RLlib] Trajectory view API - 02 actual API scaffold (#9753) 2020-08-06 10:54:20 +02:00
Sven Mika 19d785b947 [LINT] Except RLlib from checking for flake8 error F821 (#9946) 2020-08-06 10:44:37 +02:00
SongGuyang 17ddcd8691 [cpp worker] support Ray::Get() static method (#9809) 2020-08-06 16:20:05 +08:00
Eric Liang 7d4f204aa8 [Placement Group] Allow scheduling a task on any bundle (-1, default) (#9885)
* wip

* wip

* fix tests

* wip

* wip

* wip

* wip

* wip

* add test

* update

* update

* remov debug

* comments
2020-08-06 00:05:21 -07:00