[tune] improve s3 log sync (#1511)

This commit is contained in:
Eric Liang
2018-02-08 00:42:25 -08:00
committed by Richard Liaw
parent 89db7841d2
commit 41007722f9
6 changed files with 92 additions and 23 deletions
+2 -1
View File
@@ -53,6 +53,7 @@ Getting Started
"alpha": grid_search([0.2, 0.4, 0.6]),
"beta": grid_search([1, 2]),
},
"upload_dir": "s3://your_bucket/path",
}
})
@@ -72,7 +73,7 @@ This script runs a small grid search over the ``my_func`` function using Ray Tun
- my_func_4_alpha=0.4,beta=2: RUNNING [pid=6800], 209 s, 41204 ts, 70.1 acc
- my_func_5_alpha=0.6,beta=2: TERMINATED [pid=6809], 10 s, 2164 ts, 100 acc
In order to report incremental progress, ``my_func`` periodically calls the ``reporter`` function passed in by Ray Tune to return the current timestep and other metrics as defined in `ray.tune.result.TrainingResult <https://github.com/ray-project/ray/blob/master/python/ray/tune/result.py>`__.
In order to report incremental progress, ``my_func`` periodically calls the ``reporter`` function passed in by Ray Tune to return the current timestep and other metrics as defined in `ray.tune.result.TrainingResult <https://github.com/ray-project/ray/blob/master/python/ray/tune/result.py>`__. Incremental results will be saved to local disk and optionally uploaded to the specified ``upload_dir`` (e.g. S3 path).
Visualizing Results
-------------------