Commit Graph

2469 Commits

Author SHA1 Message Date
mehrdadn 92f67cd2ae Add Optional Fast Build Configuration (#8925)
* Fast builds by default

* Update doc/source/development.rst

Co-authored-by: Simon Mo <xmo@berkeley.edu>

Co-authored-by: Mehrdad <noreply@github.com>
Co-authored-by: Simon Mo <xmo@berkeley.edu>
2020-06-18 14:12:12 -07:00
Edward Oakes 8a99fd205e [dashboard] Pipe resource assignments to dashboard (#8998) 2020-06-18 11:14:59 -05:00
Alan Guo 8f9b465968 Extract out "fillout_defaults" from other config preparation actions (#8996) 2020-06-17 16:40:37 -07:00
henktillman 508149b3c3 Remove redundant logger warning (#8954) 2020-06-15 21:14:58 -07:00
SangBin Cho 3d1b8c24fd [Dashboard] Dashboard pubsub hotfix. (#8944) 2020-06-15 20:38:56 -05:00
Max Fitton 4a66b6783a Logical View: Restructuring, tooltips, and QoL changes (#8916) 2020-06-15 16:09:29 -05:00
Max Fitton ddb9368f2c Display GPU Utilization in the Dashboard (#8564) 2020-06-15 15:27:44 -05:00
Richard Liaw 6c49c01837 [tune] Function API checkpointing (#8471)
Co-authored-by: krfricke <krfricke@users.noreply.github.com>
2020-06-15 10:42:54 -07:00
Scott Graham 91e57f2e53 [azure] default workers spot instances + billing profile (#8938) 2020-06-15 10:35:20 -07:00
Jack Carreira 19cc1ae781 [docs] Tune Search: Wrong parameter name (#8927) 2020-06-13 18:01:22 -07:00
mehrdadn 101c215125 Get more tests running on Windows (#6537)
* Get rid of system() calls

* Work around '/usr/share/mini' showing up on GitHub Actions (probably due to psutil truncation)

https://github.com/ray-project/ray/runs/722480047?check_suite_focus=true

* Don't check for socket max path length on Windows

* Don't check for socket existence on Windows

* Fix race condition in Windows fate-sharing

* Work around missing .exe extension for Redis tests

* Add more tests to GitHub Actions

Co-authored-by: Mehrdad <noreply@github.com>
2020-06-12 21:32:10 -07:00
Eli Meirom 5c56760fac [tune] np.array compat for logger (#8918)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-06-12 16:39:01 -07:00
Ian Rodney 0e82f0d7c3 [autoscaler] Create Docker Command Runner (v2) (#8840)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-06-12 16:38:38 -07:00
Richard Liaw 58efec0f2b [sgd] simplify cuda visible device setting (#8775) 2020-06-12 13:53:32 -07:00
Siyuan (Ryans) Zhuang 4b31b383f3 [Core] Run Plasma Store as a Raylet thread (with a feature flag) (#8897)
* integrate plasma store as a thread (C++)

* integrate plasma store as a thread (Python)

* fix config issues

* remove plasma component fail tests

* without forcefully kill the plasma store thread
2020-06-11 22:54:08 -07:00
krfricke 060e524c92 [tune] Parameter columns can now be specified in tune reporters (#8802)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-06-11 11:30:25 -07:00
Stephanie Wang 05010caed2 [core] Fix race condition for object reconstruction (#8791)
* Fix

* doc

* Unit test

* Update src/ray/core_worker/task_manager.h

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>

* Update src/ray/core_worker/task_manager.h

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>

* Update src/ray/core_worker/task_manager.h

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>

* lint

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-06-10 19:49:12 -07:00
Edward Oakes 527b0380c9 [serve] Add microbenchmark script (#8887) 2020-06-10 21:28:52 -05:00
Edward Oakes 3a9f45c4b3 [serve] Fix worker batch queue waiting logic (#8884) 2020-06-10 21:28:16 -05:00
Max Fitton 950b389581 Actor Search Bar in Logical View (#8865) 2020-06-10 20:43:56 -05:00
Sumanth Ratna 439dbb7822 [CLI] Add version option (#8886)
Closes https://github.com/ray-project/ray/issues/8878.
2020-06-10 18:12:00 -07:00
Simon Mo cf53b35147 [Serve] Add doc for model composition (#8871)
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
2020-06-10 11:09:22 -07:00
fangfengbin a5bebd4408 Fix create actor rpc reconnect bug (#8855) 2020-06-10 10:53:53 +08:00
Simon Mo 7d52159d1a Fix Serve Flaky test_api::test_batching (#8867) 2020-06-09 16:49:17 -07:00
SangBin Cho 731ed8d232 [Core] Fix a detached actor bug fix when GCS actor management is off. (#8843) 2020-06-09 15:46:17 -07:00
mehrdadn 50f6272fcc Replace ps call with psutil (#8851)
* Replace ps call with psutil

* Minor formatting

Co-authored-by: Mehrdad <noreply@github.com>
Co-authored-by: Robert Nishihara <robertnishihara@gmail.com>
2020-06-09 14:21:19 -07:00
Sumanth Ratna 57212254e6 Fix dragonfly install instructions (#8866) 2020-06-09 13:05:04 -07:00
Richard Liaw fc54dc8652 [tune] Make test_api faster (#8844) 2020-06-09 12:45:27 -07:00
Richard Liaw d7b64ef279 [tune] BayesOpt - finish early when optimizer converges (#8808) 2020-06-09 12:09:39 -07:00
Simon Mo 6c3062906f [Serve] Batching in Worker Replica (#8709) 2020-06-09 11:29:16 -07:00
mehrdadn f93bb008bb Change os.uname()[1] and socket.gethostname() to the portable and faster platform.node_ip() (#8839)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-08 21:29:46 -07:00
Siyuan (Ryans) Zhuang 2f690d1866 Simplify plasma store config (#8823)
* simplify plasma store config
2020-06-08 20:47:22 -07:00
Kai Yang db5cc5c8da fix test_global_state_api due to the temporary object (#8800)
* fix test_global_state_api due to the temporary object

* update

* Update python/ray/tests/test_advanced_3.py

Co-authored-by: Robert Nishihara <robertnishihara@gmail.com>

Co-authored-by: Robert Nishihara <robertnishihara@gmail.com>
2020-06-09 11:42:40 +08:00
Simon Mo 5e2bd6ecb9 Fix asyncio re-entry error message (#8842) 2020-06-08 17:43:01 -07:00
SangBin Cho 3388864768 [Core] Clean up detached actors (#8759) 2020-06-08 11:22:01 -05:00
fangfengbin 68718b33b4 GCS Server add SIGTERM signal handler (#8795) 2020-06-08 17:26:36 +08:00
mehrdadn f68183d778 Error-checking for a couple of corruption issues (#8059)
* Extra error handling
* Handle connection closed in Redis monitor
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-07 15:43:00 +02:00
Edward Oakes 5d124489a9 [serve] Require backend when creating endpoint (#8764) 2020-06-06 21:10:42 -05:00
Ian Rodney b07b4f2e55 Revert "[autoscaler] Create Docker Command Runner" (#8816)
This reverts commit 54189bca5a.
2020-06-06 14:21:44 -07:00
Stephanie Wang b160b83d3e [core] Queue subscription/unsubscription commands in the GCS (#8756)
* Only remove callback index if in map

* test

* Queue subscription commands

* lint

* Check status

* update

* update

* update

* Disable GCS restart tests

* lint
2020-06-05 19:49:19 -07:00
Ian Rodney 54189bca5a [autoscaler] Create Docker Command Runner (#8806)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-06-05 17:29:27 -07:00
Alex Wu 2c485a2598 [autoscaler] Command runner interactivity (#7198) 2020-06-05 17:08:38 -07:00
Sven Mika 25c0974543 [RLlib] Issue 8412 (Adam vars not stored in ModelV2). (#8480) 2020-06-05 21:07:02 +02:00
krfricke e62c1d2051 [tune] Use scientific notation in tune dashboard (#8782)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-06-05 10:41:07 -07:00
Anil Choudhary 1dda659918 [tune]TrialRunner wait on global checkpoint syncdown (#8798) 2020-06-05 10:39:59 -07:00
Edward Oakes 4155d5830f [serve] Replace actor error retry logic with max_task_retries (#8768) 2020-06-05 10:45:28 -05:00
Amog Kamsetty 9410e5884d [Tune] Parametrize Cloud Syncing Frequency (#8771) 2020-06-04 18:55:50 -07:00
Ian Rodney d452932740 [autoscaler] Improve Logtimer log messages (#8753) 2020-06-04 18:07:27 -07:00
Ameer Haj Ali d966d98729 cleanup to support provider's custom ssh command runner (#8720)
* cleanup to support provider's custom ssh command runner

* clean up

* trailing white spaces fix

* k8s signature fix

Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local>
2020-06-04 13:27:17 -07:00
Ian Rodney 09f89ff49d [autoscaler] Improve SSH Command Failure Logging (#8751) 2020-06-04 12:38:20 -07:00