wassname/DeepRL
1
0
Fork 0
mirror of https://github.com/wassname/DeepRL.git synced 2026-09-07 16:40:41 +08:00
Code Issues Packages Projects Releases Wiki Activity
103 Commits 11 Branches 0 Tags
034e2dfe097f590cc4e775e2ba0139f867433d01
Commit Graph
103 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Clark 034e2dfe09 replace flip function 2017-11-21 08:40:23 +08:00
Mike Clark 574dbd6ecc vectorised gae calc 
vectorised advantage calculation turns out to be 40x faster, modified from here https://github.com/pmlg/deep-rl-bootcamp/blob/master/lab4/alg_utils.py#L35
 2017-11-21 08:37:33 +08:00
wassname e16a560abc let ppo work with gpu 2017-11-15 09:40:58 +08:00
wassname aec67c66f8 Merge branch 'master' of https://github.com/ShangtongZhang/DeepRL 2017-11-15 09:38:53 +08:00
Shangtong Zhang d47bb7a59a Update README 2017-11-11 21:05:03 -07:00
Shangtong Zhang 0fb70fa484 Minor fix 2017-11-11 20:58:18 -07:00
Shangtong Zhang c1fdb1bd2f Major update 2017-11-11 20:52:57 -07:00
Shangtong Zhang 8c197e183c Support D3PG 2017-11-11 19:41:52 -07:00
Shangtong Zhang edc4e89b9b Update DDPG 2017-11-11 15:27:06 -07:00
Shangtong Zhang 41627588fb Action dim 2017-11-09 16:38:42 -07:00
Shangtong Zhang e1e6446728 Minor update 2017-11-09 08:50:57 -07:00
Shangtong Zhang 347d0d22cb Fix a bug 2017-11-05 18:58:14 -07:00
Shangtong Zhang 34c6ca7dd8 Update figures 2017-11-05 00:07:38 -06:00
Shangtong Zhang 29c6ce7266 Update figures 2017-11-05 00:07:07 -06:00
Shangtong Zhang 736825a383 Update README 2017-11-05 00:02:15 -06:00
Shangtong Zhang cc1e1415c7 Merge pull request #5 from wassname/patch-2 
add eps to log_density to avoid NaN
 2017-11-04 09:13:29 -06:00
Mike Clark deab7043fc add eps to avoid NaN 
I tracked some NaN's I was getting down to here. It happens when std is a small number, then var is even smaller, and log_density=inf. There are some problems where the agent will learn to use small standard deviations because jittering movements have a high cost, this makes those more stable.
 2017-11-04 16:24:54 +08:00
wassname 662c0834f6 This helps me avoid NaN when I have small rewards 2017-11-01 18:58:03 +08:00
Shangtong Zhang 9ef309696f Merge pull request #4 from wassname/patch-1 
moving epsilon outside softplus
 2017-10-31 21:01:10 -06:00
Mike Clark 212ff0bc70 moving epsilon outside softplus 
I think you intended this to be outside the softplus. The reason is that it should be applied just before the log to avoid `log(0)=inf`.e.g.

- `log(softplus(-1000+1e-5))=log(0)=inf`. 
- `log(softplus(-1000)+1e-5)=log(1e-5)!=inf`. 

Also this fixes a NaN I had.
 2017-11-01 10:52:23 +08:00
Shangtong Zhang 55ae92619a Update README 2017-10-28 11:08:25 -06:00
Shangtong Zhang 9615195f5e Upgrade to PyTorch v0.2.0 2017-10-28 11:06:20 -06:00
Shangtong Zhang a59f2d2911 Benchmark DDPG with Roboschool 2017-10-27 23:09:24 -06:00
Shangtong Zhang af360bb9ea Support roboschool 2017-10-27 14:23:54 -06:00
Shangtong Zhang e832e2e89a Update README 2017-10-26 23:06:20 -06:00
Shangtong Zhang 6682937b54 Support python3 and pytorch 0.2 2017-10-26 23:01:57 -06:00
Shangtong Zhang 1b6de16b4f Fix a critical bug in DDPG 2017-10-15 10:05:33 -06:00
Shangtong Zhang 3ed6f2a9db Log wall time 2017-10-14 16:38:51 -06:00
Shangtong Zhang c04b2a395f Update README 2017-10-10 23:02:28 -06:00
Shangtong Zhang 51f125c01e Improve normalizer for scalar 2017-10-07 21:23:02 -06:00
Shangtong Zhang fae9a85f31 Major update 2017-10-06 22:10:44 -06:00
Shangtong Zhang 8189a5d136 Update README 2017-10-06 11:48:58 -06:00
Shangtong Zhang c5cbc10f94 Refactor DDPG 2017-10-06 11:16:21 -06:00
Shangtong Zhang 8b9fd8d24f Code cleanup 2017-10-05 21:42:27 -06:00
Shangtong Zhang dd2443c1c3 DPPO 2017-10-05 21:40:42 -06:00
Shangtong Zhang e58938e3fe Support async PPO, which doesn't work 2017-10-04 22:33:26 -06:00
Shangtong Zhang c773da7d08 Support shared stats for continuous A3C 2017-10-04 20:58:42 -06:00
Shangtong Zhang 3935dfc428 Unifying networks for continuous A3C and PPO 2017-10-04 11:03:02 -06:00
Shangtong Zhang 3adceb5284 Gaussian actor 2017-10-04 10:15:28 -06:00
Shangtong Zhang 27f54ed420 Single thread PPO 2017-10-04 09:33:35 -06:00
Shangtong Zhang e60e9feecb Refactor for HRA 2017-08-29 22:10:13 -06:00
Shangtong Zhang d52182882a Implementation of hybrid reward architecture 2017-08-29 21:52:26 -06:00
Shangtong Zhang 2b30c6e999 Update README 2017-08-03 21:02:03 -06:00
Shangtong Zhang 44e8a782af Refactor DQN 2017-08-02 14:55:04 -06:00
Shangtong Zhang b161200f0f Add BN layer 2017-08-02 14:35:51 -06:00
Shangtong Zhang 5116733f22 DDPG Pendulum 2017-08-01 10:52:14 -06:00
Shangtong Zhang 1be3b44999 Continuous A3C 2017-07-31 22:53:09 -06:00
Shangtong Zhang 473304d9a7 Update README 2017-07-30 13:36:15 -06:00
Shangtong Zhang bbfcbf76f4 Major reversion 2017-07-30 13:24:04 -06:00
Shangtong Zhang ce504e2d0f Major refactor 2017-07-26 18:18:49 -06:00