Commit Graph

378 Commits

Author SHA1 Message Date
fyrestone 05c103af94 [Dashboard] Start the new dashboard (#10131)
* Use new dashboard if environment var RAY_USE_NEW_DASHBOARD exists; new dashboard startup

* Make fake client/build/static directory for dashboard

* Add test_dashboard.py for new dashboard

* Travis CI enable new dashboard test

* Update new dashboard

* Agent manager service

* Add agent manager

* Register agent to agent manager

* Add a new line to the end of agent_manager.cc

* Fix merge; Fix lint

* Update dashboard/agent.py

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* Update dashboard/head.py

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* Fix bug

* Add tests for dashboard

* Fix

* Remove const from Process::Kill() & Fix bugs

* Revert error check of execute_after

* Raise exception from DashboardAgent.run

* Add more tests.

* Fix compile on Linux

* Use dict comprehension instead of dict(generator)

* Fix lint

* Fix windows compile

* Fix lint

* Test Windows CI

* Revert "Test Windows CI"

This reverts commit 945e01051ec95cff5fcc1c0bc37045b46e7ad9a6.

* Fix ParseWindowsCommandLine bug

* Update src/ray/util/util.cc

Co-authored-by: Robert Nishihara <robertnishihara@gmail.com>

Co-authored-by: 刘宝 <po.lb@antfin.com>
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Robert Nishihara <robertnishihara@gmail.com>
2020-08-24 13:24:23 -07:00
Olli Huotari ed6d1d7a7c [Misc] Include info about flake8_quotes in format.sh (#10123) 2020-08-15 00:09:02 -07:00
Robert Nishihara 36e626e95d Revert "[Dashboard] Start the new dashboard (#9860)" (#10116)
This reverts commit 739933e5b8.
2020-08-14 14:06:57 -07:00
Simon Mo d0c2e90577 [Build] Make sure local format.sh check protobuf (#10118)
* Ignore protobuf files for clangformat check

* Revert "Ignore protobuf files for clangformat check"

This reverts commit ccd84d4e1517220eb4e946918174150ce2265467.

* Make sure protobuf is checked locally
2020-08-14 11:22:55 -07:00
fyrestone 739933e5b8 [Dashboard] Start the new dashboard (#9860) 2020-08-13 11:01:46 +08:00
Simon Mo bb9ef511da Use the right bucket for travis logs (#10073) 2020-08-12 11:46:49 -07:00
Simon Mo f1ede1099f [Hotfix] Pin opencv-python-headless==4.3.0.36 (#10049) 2020-08-11 15:58:18 -07:00
Simon Mo 5b4a10368f Upload Travis in after_script phase (#10046)
The deploy phase is skipped when script/tests fails. This prevent us
from uploading failed result to S3.

This PR change it to after_script phase and the secret is injected
via Travis Env Var.

https://docs.travis-ci.com/user/job-lifecycle/
2020-08-11 11:46:00 -07:00
Simon Mo 4c52adddfa [Core] Type check ObjectRef (#9856)
* Type check ObjectRef

* Bug fix

* Port typing tests to bazel test
2020-08-11 10:38:29 -07:00
Simon Mo df676bc9aa Upload bazel test logs to S3 (#9884) 2020-08-10 14:26:31 -07:00
mehrdadn 5331c30e35 Improve Clang-IWYU to automatically make #include fixes (#9858)
Co-authored-by: Mehrdad <noreply@github.com>
2020-08-10 12:49:58 -07:00
Richard Liaw 328b450cde [tune] fix testing for serve-tune test breaking (#9993) 2020-08-07 23:05:18 -07:00
Barak Michener 8e76796fd0 ci: Redo format.sh --all script & backfill lint fixes (#9956) 2020-08-07 16:49:49 -07:00
Alex Wu a54d3a1cee [Autoscaler] Run resource demand scheduler in CI (#9945)
* .

* .
2020-08-07 13:30:39 -07:00
SangBin Cho 22934619df [Release] Fix release tests (#9976)
* In Progress.

* Fix torch version.

* Fix asan run.sh

* Addressed code review.
2020-08-07 10:06:13 -07:00
Sven Mika 19d785b947 [LINT] Except RLlib from checking for flake8 error F821 (#9946) 2020-08-06 10:44:37 +02:00
Sven Mika 9b90f7db67 [RLlib] Missing type annotations policy templates. (#9846) 2020-08-06 05:33:24 +02:00
Amog Kamsetty 5af7d24f66 [Tune] Transformer blog example (#9789)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-08-04 22:05:01 -07:00
Simon Mo bdc42f8dab [CI] Bring back suppress_output (#9888) 2020-08-04 11:21:20 -07:00
Simon Mo b4fb390219 Fix LINT for build-docker-images.sh (#9882) 2020-08-03 18:32:58 -07:00
Simon Mo c218f2eff6 [docker] Build docker in Travis PR & Fix image build failing (#9787)
Co-authored-by: Ian Rodney <ian.rodney@gmail.com>
2020-08-03 16:37:15 -07:00
Simon Mo edcd94f26b temporarily enable output from linux wheel builds (#9881) 2020-08-03 16:22:39 -07:00
mehrdadn b62ec7787f Ignore grep exit code for shellcheck in format.sh (#9861)
Co-authored-by: Mehrdad <noreply@github.com>
2020-08-02 00:59:05 -07:00
Sven Mika b4c527b3f3 [RLlib] Switch to PyTorch 1.6 for testing. (#9790) 2020-08-01 05:21:23 +02:00
mehrdadn 78995d085f Fix macOS incompatibility in format.sh (#9832)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-31 09:25:55 -07:00
mehrdadn e2c0174ab2 Factor out some Bazel options into .bazelrc (#9804)
* Factor out --keep_going in Bazel --config=ci

* Remove Bazel --test_timeout=600 for Windows

* Use global --test_output for Bazel CI

Co-authored-by: Mehrdad <noreply@github.com>
2020-07-30 18:09:31 -07:00
mehrdadn a7b97b6f8a Add shellcheck support (#8574) 2020-07-30 18:39:28 -05:00
Barak Michener 68f3fec744 *: Centralize requirements.txt and unify dependency versions (#9759)
* python_test: fix cython_examples in doc/ and tests/

* update setup.py to parse the bazel version string better

* all: centralize all python deps into stackable requirements files in python/

* format

* Move cython test into the proper package

* Add cross-reference dependency comments for requirements and setup.py

* re-enable version pinning on CI, fix formatting

* fix up torchvision version

* fix case in shell
2020-07-30 11:22:56 -07:00
Sven Mika b0b0463161 [RLlib] Trajectory View API (preparatory cleanup and enhancements). (#9678) 2020-07-29 21:15:09 +02:00
Simon Mo 9fbfee2424 Pin pytest version (#9767) 2020-07-28 19:54:48 -07:00
mehrdadn fb5280f21b Fix some Windows CI issues (#9708)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-28 18:10:23 -07:00
SangBin Cho c00742f103 [Release] Fix release tests (#9733) 2020-07-28 10:44:06 -07:00
mehrdadn 2949c09ee8 Fix remote-watch.py (#9625)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-27 15:54:23 -07:00
krfricke 9f3570828a [tune] move jenkins tests to travis (#9609)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-07-24 21:22:54 -07:00
mehrdadn 56d2cf6479 Shellcheck rewrites (#9597)
* Fix SC2001: See if you can use ${variable//search/replace} instead.

* Fix SC2010: Don't use ls | grep. Use a glob or a for loop with a condition to allow non-alphanumeric filenames.

* Fix SC2012: Use find instead of ls to better handle non-alphanumeric filenames.

* Fix SC2015: Note that A && B || C is not if-then-else. C may run when A is true.

* Fix SC2028: echo may not expand escape sequences. Use printf.

* Fix SC2034: variable appears unused. Verify use (or export if used externally).

* Fix SC2035: Use ./*glob* or -- *glob* so names with dashes won't become options.

* Fix SC2071: > is for string comparisons. Use -gt instead.

* Fix SC2154: variable is referenced but not assigned

* Fix SC2164: Use 'cd ... || exit' or 'cd ... || return' in case cd fails.

* Fix SC2188: This redirection doesn't have a command. Move to its command (or use 'true' as no-op).

* Fix SC2236: Use -n instead of ! -z.

* Fix SC2242: Can only exit with status 0-255. Other data should be written to stdout/stderr.

* Fix SC2086: Double quote to prevent globbing and word splitting.

Co-authored-by: Mehrdad <noreply@github.com>
2020-07-24 17:24:19 -05:00
Simon Mo a078a21437 [Serve] Allow multiple HTTP servers. (#9523) 2020-07-24 12:41:20 -07:00
Robert Nishihara 06c3518aa1 Drop support for Python 3.5. (#9622)
* Drop support for Python 3.5.

* Update setup.py
2020-07-23 19:26:06 -07:00
Simon Mo 3511b30283 Temporarily disable remote watcher (#9669) 2020-07-23 17:20:48 -07:00
Simon Mo 8df25b239f Fix lint in remote-watch.py (#9668) 2020-07-23 16:18:22 -07:00
mehrdadn 75b2fc4313 Auto-cancel build when a new commit is pushed (#8043)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-23 16:07:00 -07:00
mehrdadn b14728d999 Shellcheck quoting (#9596)
* Fix SC2006: Use $(...) notation instead of legacy backticked `...`.

* Fix SC2016: Expressions don't expand in single quotes, use double quotes for that.

* Fix SC2046: Quote this to prevent word splitting.

* Fix SC2053: Quote the right-hand side of == in [[ ]] to prevent glob matching.

* Fix SC2068: Double quote array expansions to avoid re-splitting elements.

* Fix SC2086: Double quote to prevent globbing and word splitting.

* Fix SC2102: Ranges can only match single chars (mentioned due to duplicates).

* Fix SC2140: Word is of the form "A"B"C" (B indicated). Did you mean "ABC" or "A\"B\"C"?

* Fix SC2145: Argument mixes string and array. Use * or separate argument.

* Fix SC2209: warning: Use var=$(command) to assign output (or quote to assign string).

Co-authored-by: Mehrdad <noreply@github.com>
2020-07-21 21:56:41 -05:00
Philipp Moritz a5f4659d9f Support ray task type checking (#9574) 2020-07-21 19:05:42 -07:00
mehrdadn 4f470c3fc1 Shellcheck comments (#9595) 2020-07-21 16:47:09 -05:00
mehrdadn c5cde65bc6 Add bazel to the PATH in setup.py (#9590)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-21 13:35:29 -07:00
Ian Rodney b8fc259796 [serve] Rename to Controller (#9566) 2020-07-20 12:50:29 -07:00
mehrdadn 02cbd4fb7e Skip uneeded steps on CI (#9582)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-20 12:41:57 -07:00
Richard Liaw 7e3ded7439 [tune] pin tune-sklearn (#9498) 2020-07-17 21:25:12 -07:00
mehrdadn ffb88cda6f Fix Bazel in Docker (#9530)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-17 11:39:38 -07:00
mehrdadn aa33aba1fa Fix pip and Bazel interaction messing up CI (#9506)
Co-authored-by: Mehrdad <noreply@github.com>
2020-07-16 16:28:37 -07:00
mehrdadn aa8928fac2 Make more tests compatible with Windows (#9303) 2020-07-15 11:34:33 -05:00