wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-06-27 22:38:16 +08:00
Code Issues Packages Projects Releases Wiki Activity
5,179 Commits 36 Branches 42 Tags
3d0a3c47a8a6314f78b00879d9d2b69eb72caa3b
Commit Graph

2612 Commits

Author SHA1 Message Date
mehrdadn 3d0a3c47a8 Fix Windows CI (#9588) 
Co-authored-by: Mehrdad <noreply@github.com>
 2020-07-20 12:47:27 -07:00
mehrdadn 02cbd4fb7e Skip uneeded steps on CI (#9582) 
Co-authored-by: Mehrdad <noreply@github.com>
 2020-07-20 12:41:57 -07:00
Max Fitton fca1fb18f3 Dashboard next-version API support in backend (#9345) 2020-07-20 12:54:11 -05:00
Max Fitton 051973ad23 Add dashboard dependencies to default ray installation (#9447) 2020-07-20 12:53:08 -05:00
Simon Mo d0398bf7e1 [Serve] Serialize Query object directly (#9490) 2020-07-20 10:10:07 -07:00
mehrdadn bc842a7888 Fix setup.py bug (#9581) 
Co-authored-by: Mehrdad <noreply@github.com>
 2020-07-20 15:04:35 +02:00
mehrdadn 2554a1a997 Bazel fixes (#9519) 2020-07-19 12:53:08 -07:00
Lingxuan Zuo ce3f542739 [Metric] new cython interface for python worker metric (#9469) 2020-07-19 10:43:21 +08:00
krfricke ad0219b80d [tune] fix pbt checkpoint_freq (#9517) 
* Only delete old checkpoint if it is not the same as the new one

* Return early if old checkpoint value coincides with new checkpoint value

Co-authored-by: Kai Fricke <kai@anyscale.com>
 2020-07-18 00:58:16 -07:00
jerrylee.io 4c18463fb7 [cli] ray memory: added redis_password (#9492) 2020-07-18 00:08:41 -07:00
Richard Liaw ed476be4ad quickfix (#9552) 2020-07-17 20:54:03 -07:00
Tom cf719dd470 [Tune] Copy default_columns in new ProgressReporter instances (#9537) 2020-07-17 15:44:38 -07:00
Siyuan (Ryans) Zhuang cba9545266 Add plasma store benchmark for small objects (#9549) 2020-07-17 14:20:59 -07:00
krfricke 87630cf024 [tune] Unflattened lookup for ProgressReporter (#9525) 
Co-authored-by: Kai Fricke <kai@anyscale.com>
 2020-07-17 13:52:54 -07:00
fangfengbin 5881417ec4 Fix bug that test_multi_node.py::test_multi_driver_logging hangs when GCS actor management is turned on (#9539) 
Co-authored-by: 灵洵 <fengbin.ffb@antfin.com>
 2020-07-17 11:53:29 -07:00
Simon Mo e78945db96 [Serve] Add internal instruction for running benchmarks (#9531) 2020-07-17 11:17:37 -07:00
Gabriele Oliaro 026c009086 Pipelining task submission to workers (#9363) 
* first step of pipelining

* pipelining tests & default configs
- added pipelining unit tests in direct_task_transport_test.cc
- added an entry in ray_config_def.h, ray_config.pxi, and ray_config.pxd to configure the parameter controlling the maximum number of tasks that can be in fligh to each worker
- consolidated worker_to_lease_client_ and worker_to_lease_client_ hash maps in direct_task_transport.h into a single one called worker_to_lease_entry_

* post-review revisions

* linting, following naming/style convention

* linting
 2020-07-17 10:45:13 -07:00
Stephanie Wang b351d13940 [core] Add flag to enable object reconstruction during ray start (#9488) 
* Add flag

* doc

* Fix tests
 2020-07-17 10:13:14 -07:00
Simon Mo 22a5c3d3ee Hotfix Lint for Serve (#9535) 2020-07-17 00:40:33 -07:00
mehrdadn aa33aba1fa Fix pip and Bazel interaction messing up CI (#9506) 
Co-authored-by: Mehrdad <noreply@github.com>
 2020-07-16 16:28:37 -07:00
Simon Mo 60a838f0f0 [Serve] Use pickle instead of clouldpickle (#9479) 2020-07-16 15:44:10 -07:00
Simon Mo 761b584814 [Serve] Improve buffering for simple cases (#9485) 2020-07-16 15:34:08 -07:00
Stephanie Wang baf4be245d Fix flaky test_actor_failures::test_actor_restart (#9509) 
* Fix flaky test

* os exit
 2020-07-16 10:48:33 -07:00
Ameer Haj Ali 1e46d4e29f [Autoscaler] Making bootstrap config part of the node provider interface (#9443) 
* supporting custom bootstrap config for external node providers

* bootstrap config

* renamed config to cluster_config

* lint

* remove 2 args from importer

* complete move of bootstrap to node_provider

* renamed provider_cls

* move imports outside functions

* lint

* Update python/ray/autoscaler/node_provider.py

Co-authored-by: Eric Liang <ekhliang@gmail.com>

* final fixes

* keeping lines to reduce diff

* lint

* lamba config

* filling in -> adding for lint

Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local>
Co-authored-by: Eric Liang <ekhliang@gmail.com>
 2020-07-16 09:54:20 -07:00
SangBin Cho 41ad5de1c4 Fix broken test_raylet_info_endpoint (#9511) 2020-07-16 11:51:06 -05:00
mehrdadn ac39e23145 Get rid of build shell scripts and move them to Python (#6082) 2020-07-16 11:26:47 -05:00
SangBin Cho 2f674728a6 [GCS Actor Management] Gcs actor management broken detached actor (#9473) 2020-07-16 15:41:18 +08:00
kisuke95 5e2571e214 release gil in global state accessor (#9357) 2020-07-16 11:21:10 +08:00
Stephanie Wang 4e81804cba [core] Replace task resubmission in raylet with ownership protocol (#9394) 
* Add intended worker ID to GetObjectStatus, tests

* Remove TaskID owner_id

* lint

* Add owner address to task args

* Make TaskArg a virtual class, remove multi args

* Set owner address for task args

* merge

* Fix tests

* Add ObjectRefs to task dependency manager, pass from task spec args

* tmp

* tmp

* Fix

* Add ownership info for task arguments

* Convert WaitForDirectActorCallArgs

* lint

* build

* update

* build

* java

* Move code

* build

* Revert "Fix Google log directory again (#9063)"

This reverts commit 275da2e400.

* Fix free

* Regression tests - shorten timeouts in reconstruction unit tests

* Remove timeout for non-actor tasks

* Modify tests using ray.internal.free

* Clean up future resolution code

* Raylet polls the owner

* todo

* comment

* Update src/ray/core_worker/core_worker.cc

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>

* Drop stale actor table notifications

* Fix bug where actor restart hangs

* Revert buggy code for duplicate tasks

* build

* Fix errors for lru_evict and internal.free

* Revert "Drop stale actor table notifications"

This reverts commit 193c5d20e5577befd43f166e16c972e2f9247c91.

* Revert "build"

This reverts commit 5644edbac906ff6ef98feb40b6f62c9e63698c29.

* Fix free test

* Fixes for freed objects

Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com>
 2020-07-15 14:55:51 -07:00
krfricke 5a40299d42 [tune] extend PTL template (GPU, typing fixes, tensorboard) (#9451) 
Co-authored-by: Kai Fricke <kai@anyscale.com>
 2020-07-15 10:30:20 -07:00
mehrdadn aa8928fac2 Make more tests compatible with Windows (#9303) 2020-07-15 11:34:33 -05:00
mehrdadn 33e400998c Fix name clash on Windows (#9412) 
Co-authored-by: Mehrdad <noreply@github.com>
 2020-07-14 23:14:53 -07:00
Stephanie Wang 6d99aa34a5 [core] Handle out-of-order actor table notifications (#9449) 
* Drop stale actor table notifications

* build

* Add num_restarts to disconnect handler

* Unit test and increment num_restarts on ALIVE, not RESTARTING

* Wait for pid to exit
 2020-07-14 22:55:04 -07:00
Edward Oakes 7eafe646a9 Fix flaky test_object_manager.py (#9472) 2020-07-14 18:44:48 -05:00
mehrdadn ca4f3b79db Speedups for GitHub Actions (#9343) 
Co-authored-by: Mehrdad <noreply@github.com>
 2020-07-14 14:51:51 -07:00
Michael Mui e93cde8c66 [tune] Issue 8821: ExperimentAnalysis doesn't expand user (#9461) 2020-07-14 13:53:37 -07:00
SangBin Cho 539c51a003 [Core] Support GCS server port assignment. (#8962) 2020-07-14 11:49:56 -05:00
SangBin Cho f6eb47fc1f [Stats] metrics agent exporter (#9361) 2020-07-14 11:49:16 -05:00
Siyuan (Ryans) Zhuang 5b192842b5 Fix ObjectRef and ActorHandle serialization (#9462) 2020-07-14 09:42:32 -07:00
krfricke deba082cb4 [tune] PyTorch CIFAR10 example (#9338) 
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
Co-authored-by: Kai Fricke <kai@anyscale.com>
 2020-07-13 23:16:05 -07:00
Max Fitton 222635b63f Machine View Sorting / Grouping (#9214) 
* Convert NodeInfo.tsx to a functional component

* Update NodeRowGroup to be a functional component

* lint

* Convert TotalRow to functional component.

* lint

* move node info over to using the sortable table head component. spacing is still a little wonky.

* Factor a NoewWorkerRow class out of NodeRowGroup that will be usable when grouping / ungrouping

* Compilation checkpoint, I factored the worker filtering logic out of node info into the reducer

* Add sort accessors for CPU

* Add sort accessors for Disk

* Add sort accessors for RAM

* add a table sort util for function based accessors (rather than flat attribute-based accessor)

* wip refactor node info features

* wip

* Rendering Checkpoint. I've refactored the features and how they are called to add sorting support. Also reworks the way error counts and log counts are passed to the front-end to remove some ugly logic

* wip

* wip

* wip

* Finish adding sorting and grouping of machine view

* lint

* fix bug in filtration of logs and errors by worker from recent refactor.

* Add export of Cluster Disk feature

* fix some merge issues

Co-authored-by: Max Fitton <max@semprehealth.com>
 2020-07-13 20:45:17 -05:00
SangBin Cho 22b2e51152 Fix test-multi-node (#9453) 2020-07-13 20:44:27 -05:00
Vasily Litvinov 6ad13e0da8 Add ability to specify SOCKS proxy for SSH connections (#8833) 2020-07-13 16:10:07 -07:00
Henk Tillman c7714ca575 GCP authentication using oauth tokens (#9279) 2020-07-13 14:36:40 -07:00
Ian Rodney 0085cf75d0 Allow --lru-evict to be passed into ray start (#8959) 2020-07-13 14:09:39 -07:00
Amog Kamsetty 4454d05bcf [Tune] Trainable documentation fix (#9448) 2020-07-13 13:15:01 -07:00
Nicolaus93 b5a6c57295 [tune] handling nan values (#9381) 2020-07-12 17:08:36 -07:00
Henk Tillman 8c985dc797 Update conda and ray wheel on GCP images (#9388) 2020-07-12 12:12:27 -07:00
Ian Rodney 26fcda50e7 Pass run args to DockerCommandRunner (#9411) 2020-07-10 18:09:01 -07:00
Simon Mo d4a5d09dab [Serve] Merge router with HTTPProxy (#9225) 2020-07-10 13:52:48 -07:00