bc082e9a9e
[rllib] Additional support for Shared Models in A3C ( #866 )
...
* Code for Supporting Shared Models
Running (with vnet modification) - needs to be tested for performance
Summaries
Small refactoring + generalized to more domains
Small fix for jenkins
Linting
linting
Addressing changes
Addressing changes
Update envs.py
Addressing changes
convnet
Merge - new model
final touches
final linting
Changing iterations back
removed extra change
changes for fast experimentation
changes to enable a2c
TEMP FOR DEBUGGING
ContinuousActions - Still doesn't work
InvertedPendulum trains with 8 workers - k=200
huber loss
Maxes for InvertedPendulum-v1 - 16w,200steps
temp: working with a2c
Back to shared model
more fixes
small
nit
LSTM to shared models
need to fix last_features
tuning pong
Best record for hitting 0 - with k=16,n=20
nit
a2cremoval
remove A2c reference and nits
nit
removed a2c vestiges
removing a2c
removing example.py
Linting
nit
* Linting + Removing vestigal code
* Final Touches
* nits
* rerun travis
2017-08-28 12:23:14 -07:00
617bc4d239
[rllib] Make the free_logstd param generic ( #863 )
...
* make free log std param generic
* fixes
* fixes
2017-08-24 12:43:51 -07:00
e2f2a7e57a
[rllib] Pick preprocessor based on obs shape ( #855 )
...
* update
* auto choose
2017-08-22 16:46:55 -07:00
c81821b856
[rllib] Make Pong-v0 + EvolutionStrategies work by sharing preprocessors with PPO ( #848 )
...
* fix by sharing preprocessors
* revert param changeg
* Update evolution_strategies.py
* Update catalog.py
2017-08-21 18:51:49 -07:00
c30fdb4ab0
[rllib] Code for Supporting Shared Models ( #775 )
...
* Code for Supporting Shared Models
* Running (with vnet modification) - needs to be tested for performance
* Small fix for jenkins
* Linting
* linting
* Summaries
* Small refactoring + generalized to more domains
* Addressing changes
* Addressing changes
* Update envs.py
* Addressing changes
* convnet
* final touches
* Merge - new model
* final linting
* Changing iterations back
* Policy option removed, fixed small things
* Nits
* nit
* Linting
* Linting
2017-08-03 19:29:01 -07:00
df65e87fc7
[rllib] Tune ppo more on control tasks ( #777 )
...
* tune ppo on control tasks
* introduce free log_std
* fix
* flag for writing logs
* fixes
* fixes
2017-08-03 16:34:06 -07:00
b6a18cb39b
[rllib] Also refactor DQN to use shared RLlib models ( #730 )
...
* wip
* works with cartpole
* lint
* fix pg
* comment
* action dist rename
* preprocessor
* fix test
* typo
* fix the action[0] nonsense
* revert
* satisfy the lint
* wip
* works with cartpole
* lint
* fix pg
* comment
* action dist rename
* preprocessor
* fix test
* typo
* fix the action[0] nonsense
* revert
* satisfy the lint
* Minor indentation changes.
* fix merge
* add humanoid
* initial dqn refactor
* remove tfutil
* fix calls
* fix tf errors 1
* closer
* runs now
* lint
* tensorboard graph
* fix linting
* more 4 space
* fix
* fix linT
* more lint
* oops
* es parity
* remove example.py
* fix training bug
* add cartpole demo
* try fixing cartpole
* allow model options, configure cartpole
* debug
* simplify
* no dueling
* avoid out of file handles
* Test dqn in jenkins.
* Minor formatting.
* fix issue
* fix another
* Fix problem in which we log to a directory that hasn't been created.
2017-07-26 12:29:00 -07:00
420013774c
[rllib] Pull out shared models for evolution strategies and policy gradient. ( #719 )
...
* wip
* works with cartpole
* lint
* fix pg
* comment
* action dist rename
* preprocessor
* fix test
* typo
* fix the action[0] nonsense
* revert
* satisfy the lint
* wip
* works with cartpole
* lint
* fix pg
* comment
* action dist rename
* preprocessor
* fix test
* typo
* fix the action[0] nonsense
* revert
* satisfy the lint
* Minor indentation changes.
* fix merge
* add humanoid
* fix linting
* more 4 space
* fix
* fix linT
* oops
* es parity
2017-07-17 08:58:54 +00:00
Richard Liaw