Commit Graph
380 Commits
Author SHA1 Message Date
Sven MikaandGitHub 93120e0347 Unity3D API Fixes (recent changes in Unity's MLAgents API caused errors on RLlib side). (#10285) 2020-08-26 14:16:08 +02:00
Michael LuoandGitHub 4e9888ce2f [RLlib] Dreamer (#10172) 2020-08-26 13:24:05 +02:00
Olli HuotariandGitHub 0dae50b5eb Fixed num_atoms>1 in pytorch (#10330) 2020-08-25 23:10:20 -07:00
Eric LiangandGitHub deea1861ab [rllib] Try fixing torch GPU and masking errors (#10168) 2020-08-25 18:34:19 -07:00
Benjamin BlackandGitHub 2689fb439c Fixed pettingzoo env example (#9973) 2020-08-25 13:22:25 +02:00
raoul-khour-tsandGitHub c8c4832794 Prevent Local Worker creation from blocking remote worker creation by creating remote workers before local worker (#10245)
* create remote workers before local worker

* reformatted
2020-08-24 12:29:55 -07:00
Michael LuoandGitHub 48a39d7cb9 [RLlib] Deepmind Control Suite Examples (#9751) 2020-08-23 12:53:08 +02:00
krfrickeandGitHub c31876002d [tune/rllib] made wandb compatible with rllib trainables (#10252) 2020-08-21 17:25:52 -07:00
Sven MikaandGitHub e968b52cb7 [RLlib] Trajectory view API - 03 Fast LSTM + prev actions/rewards (#9950) 2020-08-21 12:35:16 +02:00
Sven MikaandGitHub d14b501692 [RLlib] First attempt at cleaning up algo code in RLlib: PG. (#10115) 2020-08-20 17:05:57 +02:00
Raphael AvalosandGitHub 8b704eb419 Small fix for Cuda Torch DQN. (#10177) 2020-08-19 13:28:05 -07:00
Sven MikaandGitHub 2cbe29a7fa [RLlib] Curiosity minor fixes, do-overs, and testing. (#10143) 2020-08-19 17:49:50 +02:00
aff7f19360 [tune] Added logger_config field (#8521)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-18 11:10:22 -07:00
Eric LiangandGitHub ca133e2699 [rllib] Remove extra model config kwargs passed incorrectly for Torch models (#10055) 2020-08-17 11:12:20 -07:00
Julius FrostandGitHub dc659ae89a make action probabilities a numpy array (#10122) 2020-08-16 11:25:12 -07:00
Olli HuotariandGitHub 9ff599cbb8 torch policy now includes model.metrics (#10121)
* torch policy now includes model.metrics

* Fixed tests to work with custom metrics

* Forgot to run format.sh
2020-08-15 10:43:11 -07:00
Sven MikaandGitHub aeb5be7733 [RLlib] Trajectory View API (part 2.5): Actual implementations (not used yet) of a SampleCollector. (#10112) 2020-08-15 15:09:00 +02:00
Sven MikaandGitHub 2256047876 [RLlib] Rename rllib.utils.types into typing to match built-in python module's name. (#10114) 2020-08-15 13:24:22 +02:00
Chua Cheow HuanandGitHub ea51e94729 [rllib] Learning rate schedule for DDPPO. (#10006)
* Get shared metrics, increment counter & set global vars for remote workers.

* Add unit test to test lr_schedule for DDPPO.

* Broadcast the local set of global vars to remote workers instead of independently setting the global vars on each rollout worker.
2020-08-15 00:51:45 -07:00
Tanay WakhareandGitHub 1826b29757 [RLlib] Curiosity (intrinsic motivation) Exploration module. (#9912) 2020-08-13 20:14:16 +02:00
Sven MikaandGitHub 66d204e078 [RLlib] Model documentation enhancements. (#10011) 2020-08-13 13:36:40 +02:00
Sven MikaandGitHub 0effcda3e4 Add missing int-casts for all shape calculating code (using np.product([some shape])). (#10092) 2020-08-13 12:04:22 +02:00
Julius FrostandGitHub 6d9d2b320a [RLlib] Support windows drives other than C drive for the offline json API (#9909) 2020-08-13 11:57:54 +02:00
32cd94b750 [Core] Do not convert gpu id to int (#9744)
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-08-11 12:09:46 -07:00
Sven MikaandGitHub 4b10bdf8fc [RLlib] rollout.py - Add multi-agent test case. (#9981) 2020-08-10 19:44:23 +02:00
Barak MichenerandGitHub 8e76796fd0 ci: Redo format.sh --all script & backfill lint fixes (#9956) 2020-08-07 16:49:49 -07:00
Sven MikaandGitHub 5d5643e633 [RLlib] Add informative error message when bad Conv2D stack is used with fixed num_outputs (no flattening at end). (#9966) 2020-08-07 12:04:17 +02:00
Eric LiangandGitHub 668f555755 [rllib] Clean up outdated docs #9915 2020-08-06 18:29:04 -07:00
Sven MikaandGitHub 57690a3a9f [RLlib] Trajectory view API - 02 actual API scaffold (#9753) 2020-08-06 10:54:20 +02:00
Sven MikaandGitHub 19d785b947 [LINT] Except RLlib from checking for flake8 error F821 (#9946) 2020-08-06 10:44:37 +02:00
Sven MikaandGitHub 9b90f7db67 [RLlib] Missing type annotations policy templates. (#9846) 2020-08-06 05:33:24 +02:00
Michael LuoandGitHub 4d7bd8c892 [RLlib] Implementation of "Model-based Meta Policy Optimization" (MB MPO) (#9409) 2020-08-02 18:12:09 +02:00
Sven MikaandGitHub e540e425e4 [RLlib] rllib rollout test and bug fixes. (#9779) 2020-07-30 16:17:03 +02:00
Sven MikaandGitHub f6bd12eb18 [RLlib] Add tensor-based tests for Schedules and fix some bugs related to using Schedules with tensor time input. (#9782) 2020-07-30 12:49:32 +02:00
Miguel MoralesandGitHub 372114b4ed Update sampler.py (#9805)
Minor fix for warning string
2020-07-29 22:58:35 -07:00
Sven MikaandGitHub b0b0463161 [RLlib] Trajectory View API (preparatory cleanup and enhancements). (#9678) 2020-07-29 21:15:09 +02:00
Sven MikaandGitHub ff9c1dac88 [RLlib] Issue 9667 DDPG Torch bugs and enhancements. (#9680) 2020-07-28 14:15:03 +02:00
Sven MikaandGitHub e6ea33a03c [RLlib] Enhance reward clipping test; add action_clipping tests. (#9684) 2020-07-28 10:44:54 +02:00
Michael LuoandGitHub b51ab2af66 [RLlib] Offline Type Annotations (#9676)
* Offline Annotations

* Modifications

* Fixed circular dependencies

* Linter fix
2020-07-27 14:01:17 -07:00
Sven MikaandGitHub 5dc4b6686e [RLlib] Implement DQN PyTorch distributional head. (#9589) 2020-07-25 09:29:24 +02:00
46c64c90d0 fixed simplex initialisation seeding bug (#9660)
Co-authored-by: Petros Christodoulou <petrochr@amazon.com>
2020-07-24 14:22:41 -07:00
Sven MikaandGitHub e4c5d3526f Issue 9631: Tf1.14 does not have tf.config.list_physical_devices. (#9681) 2020-07-24 21:48:58 +02:00
Eric LiangandGitHub 590943a499 [rllib] Type annotations for model classes (#9646) 2020-07-24 12:01:46 -07:00
Eric LiangandGitHub 5acd3e66dd [rllib] Fix torch TD error, IMPALA LR updates (#9477)
* update

* add test

* lint

* fix super call

* speed es test up
2020-07-23 12:50:25 -07:00
Raphael AvalosandGitHub 5303c3abe3 Fix TorchDeterministic (#9241) 2020-07-23 10:43:20 -07:00
Sven MikaandGitHub 75592e664f Issue 9568: rllib train framework in config gets overridden with tf. (#9572) 2020-07-21 22:02:24 +02:00
Raphael AvalosandGitHub 440c9c42be [RLlib] Fix combination of lockstep and multiple agnts controlled by the same policy. (#9521)
* Change aggregation when lockstep is activated.

Modification of MultiAgentBatch.timeslices to support the combination of lockstep and multiple agents controlled by the same policy.

fix ray-project/ray#9295

* Line too long.
2020-07-19 23:03:12 -07:00
Sven MikaandGitHub 887cf5eca7 MADDPG learning confirmation test. (#9538) 2020-07-17 20:18:02 +02:00
Sven MikaandGitHub 78dfed2683 [RLlib] Issue 8384: QMIX doesn't learn anything. (#9527) 2020-07-17 12:14:34 +02:00
Sven MikaandGitHub 8204717eed [RLlib] Issue 9218: PyTorch Policy places Model on GPU even with num_gpus=0 (#9516) 2020-07-17 05:53:25 +02:00