wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-04 22:12:41 +08:00
Code Issues Packages Projects Releases Wiki Activity

[rllib] A3C Configurations (#1370)

Browse Source 
* initial introduction of a3c configs

* fix sample batch

* flake but need to check save

* save,resotre

* fix

* pickles

* entropy

* fix

* moving ppo

* results

* jenkins
This commit is contained in:
Richard Liaw
2017-12-24 12:25:13 -08:00
committed by Eric Liang
parent b217a5ef14
commit 4bb5b6bd5b
15 changed files with 164 additions and 113 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/ray/rllib/optimizers/async.py
+1 -2
View File
@@ -35,8 +35,7 @@ class AsyncOptimizer(Optimizer):
# Note: can't use wait: https://github.com/ray-project/ray/issues/1128
while gradient_queue:
with self.wait_timer:
fut, e = gradient_queue[0]
gradient_queue = gradient_queue[1:]
fut, e = gradient_queue.pop(0)
gradient = ray.get(fut)
if gradient is not None: