4 Commits
Author SHA1 Message Date
Donghyeon Kim 18d6824191 Refactoring demo collector (#56) 2019-08-17 14:29:58 +09:00
Kyunghwan Kim d2769dfa9d Convert code to python 2.7 (#35)
* Convert code format to python2.7 (SAC)

* Convert code format python2.7 (TD3, all fD)

* Remove no use import and black setting

* Change SAC param

* Change env name Reacher-v2 to v1

* Remove old version reacher training script

* Convert code format python2.7

* Modify .travis.yml

* Add install command python3.6 & black on Makefile

* Fix seperator to tab on Makefile

* Modify Makefile

* Fix little error

* Change td3 gamma parameter
2019-03-25 19:07:19 +09:00
Seungjae Ryan Lee 00c3dc4286 Remove DDPG (#28)
* Change default algorithm from DDPG to SAC

* Remove DDPG examples

* Remove DDPG algorithms

DDPG, DDPG+PER, DDPGfD

* Fix parser bug in LunarLanderContinuous
2019-03-21 23:51:39 +09:00
Seungjae Ryan Lee ca5c99bc41 Add DDPGfD, TD3fD and SACfD (#22)
* Format repository

* Clone files from medipixel repo

* Fix DDPGfDAgent.update_model()

* Fix bug on _initialize()

* Add demo-path parameter and demo data

* Rename init_priority to _max_priority for PER

This makes PER and PERfD consistent.

* Make i_episode attribute of DDPGAgent

* Clone SAC code from medipixel repo

* Fix update_model() for SACfD

* Fix _initialize() for SACfD

* Add is_discrete attribute to AbstractAgent for SACfD

* Add i_episode attribute to SACAgent for SACfD

* Modularize DDPGAgent and SACAgent

* Modify hyperparameters for DDPGfD and SACfD

* Add NStepBuffer

* Add n-step to DDPGfD

* Add n-step to SACfD

* Add TD3fD without n-step

* Attempt to tune hyperparameters

* Remove discrete environment check in SAC

* Implement n-step on TD3fD

* Fix step function of TD3

No done check, and _add_transition_to_memory was not called.

* Fix actor loss calculation for TD3fD

* Attempt to tune hyperparameters

* Print both critic losses

* Fix typo bug

* Attempt to tune hyperparameters

* Fix bug in n-step demo retrieval

* Fix bug in n-step transition addition
2019-03-14 11:06:54 +09:00