wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-21 12:50:45 +08:00
Code Issues Packages Projects Releases Wiki Activity
4,931 Commits 36 Branches 42 Tags
cf0894d396113fdf87da4e8b9d28fc669fca2d24
Commit Graph
300 Commits
Author SHA1 Message Date
Michael LuoGitHubSven Mika
 		cf0894d396 [rllib] MAML Agent (#8862) 
* Halfway done with transferring MAML to new Ray

* MAML Beta Out

* Debugging MAML atm

* Distributed Execution

* Pendulum Mass Working

* All experiments complete

* Cleaned up codebase

* Travis CI

* Travis CI

* Tests

* Merged conflicts

* Fixed variance bug conflict

* Comment resolved

* Apply suggestions from code review

fixed test_maml

* Update rllib/agents/maml/tests/test_maml.py

* asdf

* Fix testing

Co-authored-by: Sven Mika <sven@anyscale.io>
 2020-06-23 09:48:23 -07:00
Sven MikaandGitHub 2589309cf0 [RLlib] Make sure torch and tf behave the same wrt conv2d nets. (#8785) 2020-06-20 00:05:19 +02:00
Max FittonandGitHub ad09aa985c Make Dashboard Port Configurable (#8999) 2020-06-19 16:26:22 -05:00
Eric LiangandGitHub 1e0e1a45e6 [rllib] Add type annotations for evaluation/, env/ packages (#9003) 2020-06-19 13:09:05 -07:00
Ian RodneyandGitHub 2e972c2a77 RLLIB and pylintrc (#8995) 2020-06-17 18:14:25 +02:00
Ian RodneyandGitHub 265ddfc2e4 blacklist to remove (#8994) 2020-06-17 18:02:28 +02:00
Joseph SuarezandGitHub c6ee3cdff4 Refactor #8792 to integrate latest master (#8956) 2020-06-17 10:55:52 +02:00
Sven MikaandGitHub 14405b90d5 [RLlib] Prototype of a DynaTrainer (for env dynamics learning in upcoming MBMPO algo). (#8860) 2020-06-16 09:01:20 +02:00
Sven MikaandGitHub 7008902cff [RLlib] Minor rllib.utils cleanup. (#8932) 2020-06-16 08:52:20 +02:00
Sven MikaandGitHub 0c7764b010 Issue 8919 checkpoint at end ignored (#8933) 2020-06-16 08:51:20 +02:00
Sven MikaandGitHub bdf1404a5f [RLlib] Issue 8714: QMIX init error w/ tuple obs space. (#8936) 2020-06-16 08:50:53 +02:00
Sven MikaandGitHub 4ed796a7d6 [RLlib] Add testing Policy.compute_single_action() for all agents. (#8903) 2020-06-13 17:51:50 +02:00
Eric LiangandGitHub 34bae27ac7 [rllib] Flexible multi-agent replay modes and replay_sequence_length (#8893) 2020-06-12 20:17:27 -07:00
Sven MikaandGitHub 8d1ccfd0f7 [RLlib] Issue 8889: action clipping bug ppo not learning mujoco (#8898) 2020-06-11 19:17:43 +02:00
Sven MikaandGitHub a90cd0fcbb [RLlib] Unity3d soccer benchmarks (#8834) 2020-06-11 14:29:57 +02:00
Kristian HolsheimerandGitHub ea965d7c52 [RLlib] use Mapping instead of dict in summarize() to accommodate non-dict grads/params (e.g. haiku's frozendict) (#8793) 2020-06-11 00:37:15 -07:00
Dean WamplerandGitHub 53712d2ef7 Fix typo in docs for LinearDiscreteEnv (#8891) 2020-06-11 08:34:35 +02:00
Sven MikaandGitHub 0ba7472da9 [Testing] Fix LINT/sphinx errors. (#8874) 2020-06-10 15:41:59 +02:00
Eric LiangGitHubSven Mika
 		831b2fe51d [rllib] Set framework to tf by default and remove import checks; "Auto" option (#8748) 
* tf by default

* Update rllib/agents/trainer.py

Co-authored-by: Sven Mika <sven@anyscale.io>

* remove it

* fix

* remove

* fix

* lint

Co-authored-by: Sven Mika <sven@anyscale.io>
 2020-06-08 23:04:50 -07:00
mehrdadnandGitHub f93bb008bb Change os.uname()[1] and socket.gethostname() to the portable and faster platform.node_ip() (#8839) 
Co-authored-by: Mehrdad <noreply@github.com>
 2020-06-08 21:29:46 -07:00
Sven MikaandGitHub ad695a818b Bug fix in the contextual bandit's linear_regression.py model. (#8815) 2020-06-06 22:47:42 +02:00
Eric LiangandGitHub be26a7b1b0 [rllib] Support for complex / variable-length observation spaces (#8393) 2020-06-06 12:22:19 +02:00
Sven MikaandGitHub 25c0974543 [RLlib] Issue 8412 (Adam vars not stored in ModelV2). (#8480) 2020-06-05 21:07:02 +02:00
Sven MikaandGitHub c74dc58f8b [RLlib] Fix use_lstm flag for ModelV2 (w/o ModelV1 wrapping) and add it for PyTorch. (#8734) 2020-06-05 15:40:30 +02:00
Sven MikaandGitHub 97d524c075 [RLlib] Issue 8769 broken OOM tests_dir cases (R & S). (#8770) 2020-06-05 08:34:21 +02:00
Sven MikaandGitHub 368088be85 [RLlib] Sample batch docs and cleanup. (#8778) 2020-06-04 22:47:32 +02:00
Victor LeandGitHub aee01133cd Fix dict/tuple hybrid action space for tensorflow eager execution (#8781) 2020-06-04 13:28:46 -07:00
Eric LiangandGitHub 1e4a1360fd [rllib] Add type annotations to Trainer class (#8642) 
* type trainer

* type it

* fxi
 2020-06-03 12:47:35 -07:00
Tanay WakhareandGitHub c773824f4f [RLlib] Bug fixes and tests in DiagGaussian (#8676) 2020-06-03 19:06:06 +02:00
Sven MikaandGitHub b37a162076 [RLlib] Make envs specifiable in configs by their class path. (#8750) 2020-06-03 08:14:29 +02:00
Edward OakesandGitHub ae312af435 Remove accidental passes in rllib, tune (#8742) 2020-06-02 12:29:17 -05:00
Sven MikaandGitHub d8a081a185 [RLlib] Unity3D integration (n Unity3D clients vs learning server). (#8590) 2020-05-30 22:48:34 +02:00
Sven MikaandGitHub d483ed28ba [RLlib] Fix broken tune tests in master due to framework=auto errors. (#8672) 2020-05-29 11:55:47 +02:00
Tomasz WronaandGitHub f266318a01 [rllib] Do not store torch tensors when using grad clipping (#8509) 2020-05-28 12:06:27 -07:00
Sven MikaandGitHub 2746fc0476 [RLlib] Auto-framework, retire use_pytorch in favor of framework=... (#8520) 2020-05-27 16:19:13 +02:00
konichuvakandGitHub 13c2e13120 fixing polynomial schedule horizon (#7795) 2020-05-27 10:59:28 +02:00
Paco NathanandGitHub 067bbb6710 resolved NameError in ray.tune() call (#8494) 2020-05-27 10:55:56 +02:00
Sven MikaandGitHub c7a2e3f309 [RLlib] Removed config["sample_async"] restriction for A3C-torch. (#8617) 2020-05-27 10:22:49 +02:00
Sven MikaandGitHub 6d196197bc [RLlib] utils/spaces ... (#8608) 2020-05-27 10:21:30 +02:00
Sven MikaandGitHub 0422e9c5a8 [RLlib] Add 2 Transformer learning test cases on StatelessCartPole (PPO and IMPALA). (#8624) 2020-05-27 10:19:47 +02:00
Sven MikaandGitHub baa053496a [RLlib] Benchmark and regression test yaml cleanup and restructuring. (#8414) 2020-05-26 11:10:27 +02:00
Jan BlumenkampandGitHub d6f78f58dc Fix missing learning rate and entropy coeff schedule for torch PPO (#8572) 2020-05-23 10:54:18 -07:00
Sven MikaandGitHub 8870270164 [RLlib] Add QMIX support for complex obs spaces (Issue 8523). (#8533) 2020-05-22 10:17:51 +02:00
Eric LiangandGitHub 9a83908c46 [rllib] Deprecate policy optimizers (#8345) 2020-05-21 10:16:18 -07:00
Sven MikaandGitHub 3a234ed9e3 [RLlib] Error: "Unknown trainable [some rllib algo name]" (#8525) 2020-05-21 08:59:32 +02:00
Sven MikaandGitHub d76578700d [RLlib] Policy.compute_single_action() broken for nested actions (Issue 8411). (#8514) 2020-05-20 22:29:08 +02:00
mehrdadnandGitHub ebf060d484 Make more tests run on Windows (#8446) 
* Remove worker Wait() call due to SIGCHLD being ignored

* Port _pid_alive to Windows

* Show PID as well as TID in glog

* Update TensorFlow version for Python 3.8 on Windows

* Handle missing Pillow on Windows

* Work around dm-tree PermissionError on Windows

* Fix some lint errors on Windows with Python 3.8

* Simplify torch requirements

* Quiet git clean

* Handle finalizer issues

* Exit with the signal number

* Get rid of wget

* Fix some Windows compatibility issues with tests

Co-authored-by: Mehrdad <noreply@github.com>
 2020-05-20 12:25:04 -07:00
Eric LiangandGitHub aa7a58e92f [rllib] Support training intensity for dqn / apex (#8396) 2020-05-20 11:22:30 -07:00
Sven MikaandGitHub 796a834c48 [RLlib] Attention Net integration into ModelV2 and learning RL example. (#8371) 2020-05-18 17:26:40 +02:00
Dennis van der HoffGitHubdevanderhoff
 		be1f158747 Added Done to MultiAgentExternalEnv. (#8478) 
Co-authored-by: devanderhoff <devanderhoff@hotmail.com>
 2020-05-17 16:29:47 -07:00