[rllib] Changes for preprocessors (#1033)

* Changes for preprocessors

* removed comments

* Changes + push for lint

* linted

* adding dependency for travis

* linting won't pass

* reordering

* needed for testing

* added comments

* pip it

* pip dependencies
This commit is contained in:
Richard Liaw
2017-09-30 13:11:20 -07:00
committed by Philipp Moritz
parent 2d0f439b7b
commit 16e82b43d1
7 changed files with 67 additions and 59 deletions
+1 -1
View File
@@ -103,4 +103,4 @@ docker run --shm-size=10G --memory=10G $DOCKER_SHA \
--env MontezumaRevenge-v0 \
--alg PPO \
--num-iterations 2 \
--config '{"kl_coeff": 1.0, "num_sgd_iter": 10, "sgd_stepsize": 1e-4, "sgd_batchsize": 64, "timesteps_per_batch": 2000, "num_workers": 1, "model": {"downscale_factor": 4, "conv_filters": [[16, [8, 8], 4], [32, [4, 4], 2], [512, [5, 5], 1]]}, "extra_frameskip": 4}'
--config '{"kl_coeff": 1.0, "num_sgd_iter": 10, "sgd_stepsize": 1e-4, "sgd_batchsize": 64, "timesteps_per_batch": 2000, "num_workers": 1, "model": {"dim": 40, "conv_filters": [[16, [8, 8], 4], [32, [4, 4], 2], [512, [5, 5], 1]]}, "extra_frameskip": 4}'