6848dfd179
[rllib] Replace ray.get() with ray_get_and_free() to optimize memory usage ( #4586 )
2019-04-17 20:30:03 -04:00
6e7680bf21
[rllib] Clean up concepts documentation and policy optimizer creation ( #4592 )
2019-04-12 21:03:26 -07:00
09b2961750
[rllib] Ensure stats are consistently reported across all algos ( #4445 )
2019-03-27 15:40:15 -07:00
8df772867c
[rllib] rename compute_apply to learn_on_batch
2019-02-11 15:22:15 -08:00
8b5827b9da
[rllib] Better document which methods are abstract and which ones are overrides ( #3480 )
2018-12-08 16:28:58 -08:00
221d1663c1
[rllib] switch to python logger ( #3098 )
...
* logg
* set rllib logger
* comment
* info
* rlib
* comment
* add format
* fix lint
* add file info
* update
* add ts
* lint
* better docs
* fix value error
* soft log level
2018-10-21 23:43:57 -07:00
995ac24a2c
[rllib] clarify train batch size for PPO ( #2793 )
...
It's possible to configure PPO in a way that ends up discarding most of the samples (they are treated as "stragglers"). Add a warning when this happens, and raise an exception if the waste is particularly egregious.
2018-09-05 12:06:13 -07:00
aa014af85b
[rllib] Fix atari reward calculations, add LR annealing, explained var stat for A2C / impala ( #2700 )
...
Changes needed to reproduce Atari plots in IMPALA / A2C: https://github.com/ray-project/rl-experiments
2018-08-23 17:49:10 -07:00
fbe6c59f72
[rllib] Misc fixes, A2C ( #2679 )
...
A bunch of minor rllib fixes:
pull in latest baselines atari wrapper changes (and use deepmind wrapper by default)
move reward clipping to policy evaluator
add a2c variant of a3c
reduce vision network fc layer size to 256 units
switch to 84x84 images
doc tweaks
print timesteps in tune status
2018-08-20 15:28:03 -07:00
981d9818c1
[rllib] Support the timesteps_per_batch in simple optimizer PPO mode ( #2558 )
...
* support ts
* doc
* Update sync_samples_optimizer.py
2018-08-06 12:10:59 -07:00
d01dc9e22d
[rllib] format with yapf ( #2427 )
...
* initial yapf
* manual fix yapf bugs
2018-07-19 15:30:36 -07:00
b316afeb43
[rllib] Add debug info back to PPO and fix optimizer compatibility ( #2366 )
2018-07-12 19:22:46 +02:00
d24f19fd1e
[rllib] Fix stats collection and some docs bugs since the refactoring ( #2361 )
...
* fix
* fix pbt example
* fix
* fix
* single thread by default
* vec
* fix
* fix
2018-07-07 13:29:20 -07:00
e32aed8717
[rllib] more user-friendly Optimizer signature + compute_apply ( #2335 )
...
* Move signature of optimizers
* fix
* expose compute_apply for policy_graphs
* dictionaries and such
* test for multiagent
2018-07-07 12:08:49 -07:00
8aa56c12e6
[rllib] Document "v2" APIs ( #2316 )
...
* re
* wip
* wip
* a3c working
* torch support
* pg works
* lint
* rm v2
* consumer id
* clean up pg
* clean up more
* fix python 2.7
* tf session management
* docs
* dqn wip
* fix compile
* dqn
* apex runs
* up
* impotrs
* ddpg
* quotes
* fix tests
* fix last r
* fix tests
* lint
* pass checkpoint restore
* kwar
* nits
* policy graph
* fix yapf
* com
* class
* pyt
* vectorization
* update
* test cpe
* unit test
* fix ddpg2
* changes
* wip
* args
* faster test
* common
* fix
* add alg option
* batch mode and policy serving
* multi serving test
* todo
* wip
* serving test
* doc async env
* num envs
* comments
* thread
* remove init hook
* update
* fix ppo
* comments1
* fix
* updates
* add jenkins tests
* fix
* fix pytorch
* fix
* fixes
* fix a3c policy
* fix squeeze
* fix trunc on apex
* fix squeezing for real
* update
* remove horizon test for now
* multiagent wip
* update
* fix race condition
* fix ma
* t
* doc
* st
* wip
* example
* wip
* working
* cartpole
* wip
* batch wip
* fix bug
* make other_batches None default
* working
* debug
* nit
* warn
* comments
* fix ppo
* fix obs filter
* update
* wip
* tf
* update
* fix
* cleanup
* cleanup
* spacing
* model
* fix
* dqn
* fix ddpg
* doc
* keep names
* update
* fix
* com
* docs
* clarify model outputs
* Update torch_policy_graph.py
* fix obs filter
* pass thru worker index
* fix
* rename
* vlad torch comments
* fix log action
* debug name
* fix lstm
* remove unused ddpg net
* remove conv net
* revert lstm
* wip
* wip
* cast
* wip
* works
* fix a3c
* works
* lstm util test
* doc
* clean up
* update
* fix lstm check
* move to end
* fix sphinx
* fix cmd
* remove bad doc
* envs
* vec
* doc prep
* models
* rl
* alg
* up
* clarify
* copy
* async sa
* fix
* comments
* fix a3c conf
* tune lstm
* fix reshape
* fix
* back to 16
* tuned a3c update
* update
* tuned
* optional
* merge
* wip
* fix up
* move pg class
* rename env
* wip
* update
* tip
* alg
* readme
* fix catalog
* readme
* doc
* context
* remove prep
* comma
* add env
* link to paper
* paper
* update
* rnn
* update
* wip
* clean up ev creation
* fix
* fix
* fix
* fix lint
* up
* no comma
* ma
* Update run_multi_node_tests.sh
* fix
* sphinx is stupid
* sphinx is stupid
* clarify torch graph
* no horizon
* fix config
* sb
* Update test_optimizers.py
2018-07-01 00:05:08 -07:00
44f5f0520b
[rllib] Rename optimizers for clarity ( #2303 )
...
* rename
* fix
* update
* mgpu
* Update a3c.py
* Update bc.py
* Update a3c.py
* Update test_optimizers.py
* Update a3c.py
2018-06-27 02:30:15 -07:00
Eric Liang