Fix problem in which actors and workers running tasks are not killed by driver exit. (#490)

* Augment test to verify that relevant workers and actors are killed during driver cleanup.

* Fix bug in which we were only killing one worker when a driver exited.

* Fix remove driver test.

* Fix and augment test.
This commit is contained in:
Robert Nishihara
2017-04-26 15:13:39 -07:00
committed by Philipp Moritz
parent b7ace01b5f
commit 1627f89945
5 changed files with 208 additions and 48 deletions
+5 -1
View File
@@ -275,6 +275,10 @@ if __name__ == "__main__":
num_gpus = ([int(i) for i in args.num_gpus.split(",")]
if args.num_gpus is not None else num_nodes * [0])
# Parse the driver locations.
driver_locations = (None if args.driver_locations is None
else [int(i) for i in args.driver_locations.split(",")])
d = DockerRunner()
d.start_ray(docker_image=args.docker_image, mem_size=args.mem_size,
shm_size=args.shm_size, num_nodes=num_nodes,
@@ -282,7 +286,7 @@ if __name__ == "__main__":
development_mode=args.development_mode)
try:
run_results = d.run_test(args.test_script, args.num_drivers,
driver_locations=args.driver_locations)
driver_locations=driver_locations)
finally:
d.stop_ray()