[rllib] Rollout extensions (#6065)

* Rollout improvements

* Make info-saving optional, to avoid breaking change.

* Store generating ray version in checkpoint metadata

* Keep the linter happy

* Add small rollout test

* Terse.

* Update test_io.py
This commit is contained in:
David Bignell
2019-11-06 04:34:18 +00:00
committed by Eric Liang
parent 2a0225dd25
commit 3f83b2daa9
4 changed files with 211 additions and 20 deletions
+2 -1
View File
@@ -292,7 +292,8 @@ class Trainable(object):
"timesteps_total": self._timesteps_total,
"time_total": self._time_total,
"episodes_total": self._episodes_total,
"saved_as_dict": saved_as_dict
"saved_as_dict": saved_as_dict,
"ray_version": ray.__version__
}, f)
return checkpoint_path