wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-09-12 12:51:15 +08:00
Code Issues Packages Projects Releases Wiki Activity

Fault tolerance race (#894)

Browse Source 
* Remove race between local scheduler disconnecting and global scheduler
assigning a task

* Fix number of workers started in component failures test

* Fix race between global scheduler retrying a task assignment and monitor
cleaning up task table. The global scheduler should only retry the task
assignment if the local scheduler is still alive.

* Clean up task_table_update callback if failure

* Look up current local scheduler mapping when retrying actor task submission

* Log warning if no subscribers received a task table update

* Clean up database handle memory in local scheduler
This commit is contained in:
Stephanie Wang
2017-08-30 22:20:50 -07:00
committed by Robert Nishihara
parent deca29a7eb
commit 7496c98010
7 changed files with 128 additions and 85 deletions
Download Patch File Download Diff File Expand all files Collapse all files
test/component_failures_test.py
+1 -1
View File
@@ -131,7 +131,7 @@ class ComponentFailureTest(unittest.TestCase):
num_local_schedulers = 4
num_workers_per_scheduler = 8
ray.worker._init(
num_workers=num_local_schedulers * num_workers_per_scheduler,
num_workers=num_workers_per_scheduler,
num_local_schedulers=num_local_schedulers,
start_ray_local=True,
num_cpus=[num_workers_per_scheduler] * num_local_schedulers,