wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-24 13:20:22 +08:00
Code Issues Packages Projects Releases Wiki Activity
3,662 Commits 36 Branches 42 Tags
38b43fb3ca70205f2ef3d4b2e019bbffba7dfd73
Commit Graph
3662 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Eric LiangandGitHub b1c9ea7ffc Update test_trial_scheduler.py (#4710) 2019-04-27 23:11:05 -07:00
Daniel HoandEric Liang d7d2694b57 [tune] Add config logging functionality to PBT scheduler (#4680) 2019-04-27 19:32:19 -07:00
Romil BhardwajandRobert Nishihara 686d4caefe Updates to scheduling objects to support dynamic custom resources (#4465) 2019-04-27 18:45:23 -07:00
Si-YuanandGitHub 9ce3039390 Fix webui api (#4686) 
* fix webui

* Apply suggestions from code review

lint

Co-Authored-By: suquark <suquark@gmail.com>

* add dependencies for this unittest

* move dependencies to the script file
 2019-04-27 15:23:56 +08:00
Sam ToyerandEric Liang 663e92ab3f [rllib] TD3/DDPG improvements and MuJoCo benchmarks (#4694) 
* [rllib] Separate optimisers for DDPG actor & crit.

* [rllib] Better names for DDPG variables & options

Config changes:

- noise_scale -> exploration_ou_noise_scale
- exploration_theta -> exploration_ou_theta
- exploration_sigma -> exploration_ou_sigma
- act_noise -> exploration_gaussian_sigma
- noise_clip -> target_noise_clip

* [rllib] Make DDPG less class-y

Used functions to replace three classes with only an __init__ method & a
handful of unrelated attributes.

* [rllib] Refactor DDPG noise

* [rllib] Unify DDPG exploration annealing

Added option "exploration_should_anneal" to enable linear annealing of
exploration noise. By default this is off, for consistency with DDPG &
TD3 papers. Also renamed "exploration_final_eps" to
"exploration_final_scale" (that name seems to have been carried over
from DQN, and doesn't really make sense here). Finally, tried to rename
"eps" to "noise_scale" wherever possible.
 2019-04-26 17:49:53 -07:00
Andy JonesandRobert Nishihara 05c896d6f7 Adds a note on how to avoid contention when using PyTorch. (#4692) 2019-04-26 13:22:26 -07:00
Eric LiangandGitHub 47cca971b5 Don't delete files in rsync up, and also shorten timeout (#4688) 2019-04-25 12:18:42 -07:00
Devin PetersohnandRobert Nishihara fb2655fa93 Update Release Process documentation (#4670) 2019-04-25 00:05:19 -07:00
Qing WangandHao Chen c26f24ab9f Integrate metric items into raylet (#4602) 2019-04-25 11:40:24 +08:00
Qing WangandHao Chen f39b6747e5 Refactor command line argument parsing with gflags (#4676) 2019-04-24 14:53:07 +08:00
Qing WangandHao Chen 4dd628a837 [Java] Do not expose GcsClient to normal users (#4675) 2019-04-24 10:50:35 +08:00
William MaandRobert Nishihara c99e3caaca Change resource bookkeeping to account for machine precision. (#4533) 2019-04-23 11:59:53 -07:00
Si-YuanandPhilipp Moritz b4ee50ff60 use an alternative boost mirror (#4685) 2019-04-23 11:33:22 -07:00
justinwyangandRobert Nishihara 8dfc833a8b Change all instances of JobID to DriverID. (#4431) 2019-04-22 16:28:09 -07:00
AndrewandEric Liang 06c768823c [rllib] train-eval loop implementation for rllib.Trainer class (#4647) 2019-04-21 12:08:04 -07:00
Wang QingandRobert Nishihara d951eb740f [Metrics] Add a flag to disable stdout exporter (#4634) 2019-04-19 19:06:30 -07:00
Devin PetersohnandRobert Nishihara d5df91b031 Bump version to 0.7.0dev3 (#4671) 2019-04-19 17:06:14 -07:00
justinwyangandRobert Nishihara 2f4b784d0e Fixe flakequotes to allow escaping quotes (#4666) 2019-04-19 13:55:20 -07:00
Eric LiangandGitHub ce66a552bf Move large mem test to end (#4664) 2019-04-19 11:43:22 -07:00
Vlad FiroiuandEric Liang 39a09fa457 Turn replay into a circular queue. (#4667) 2019-04-19 11:42:00 -07:00
Wang QingandEric Liang 9d481cc2e6 [hotfix] Missing import breaks Travis builds 2019-04-18 23:12:44 -07:00
Wang QingandEric Liang 0d433b220c [hotfix] Hot fix for CI linting error 2019-04-18 21:48:55 -07:00
Eric LiangandGitHub 5a562bbf12 [rllib] Fix num_gpus cast and raise error on large batch (#4652) 2019-04-18 15:23:29 -07:00
Hao ChenandGitHub be2cbdf130 [Bazel] Use rules_jvm_external to manage java dependencies (#4615) 2019-04-18 16:53:25 +08:00
Eric LiangandGitHub 6848dfd179 [rllib] Replace ray.get() with ray_get_and_free() to optimize memory usage (#4586) 2019-04-17 20:30:03 -04:00
Devin PetersohnandRobert Nishihara 20c4c16891 Upload wheels from all branches to support release branches (#4651) 2019-04-17 16:24:55 -07:00
Eric LiangandGitHub 3fd9dea721 [rllib] Fix tune.run(Agent class) (#4630) 
* update

* Update __init__.py
 2019-04-15 09:12:23 -07:00
Richard LiawandGitHub 776a7308c8 [tune] Better ASHA defaults (#4623) 
## What do these changes do?
Sets ASHA defaults to paper defaults.


## Related issue number


## Linter

- [ ] I've run `scripts/format.sh` to lint the changes in this PR.
 2019-04-15 01:45:43 -07:00
Vlad FiroiuandEric Liang f600591468 Cast MultiCategorical num_outputs to int. (#4629) 2019-04-14 19:51:37 -07:00
Robert NishiharaandPhilipp Moritz 967e8aad9d Make def test_submitting_many_actors_to_one less stressful. (#4622) 2019-04-14 12:19:57 -07:00
Andrew TanandEric Liang 57af1c6819 Update volume size to 100 (#4616) 2019-04-14 11:40:16 -07:00
Zachary BarryandKristian Hartikainen 3838548356 Custom SSH socket directories (#4299) 
* ssh_control_path added as an auth option.

* revamped default ssh options to take in control path, nodeupdater checks auth config to see if a custom SSH sockets path was specified, otherwise the original hardcoded path is used. control path is now a nodeupdater instance variable

* revert socketdir in auth config and change method for determining dir

* new ssh dir method

* Lint

* ' -> " lint

* changed using USER env to getpass.getuser()
 2019-04-13 23:55:41 -07:00
Daniel EdgecumbeandRobert Nishihara 3e1adafbce [autoscaler] Add an aggressive_autoscaling flag (#4285) 2019-04-13 18:44:32 -07:00
Devin PetersohnandRobert Nishihara 56a78baf67 Bump version to 0.6.6 (#4621) 2019-04-13 10:37:17 -07:00
Hao ChenandGitHub d52b080081 [Java] Avoid unnecessary memory copy and addd a benchmark (#4611) 2019-04-14 00:17:04 +08:00
Richard LiawandEric Liang 0bfb0d2c29 [tune] Fix checkpointing for Gym Types 2019-04-12 21:03:56 -07:00
Eric LiangandGitHub 6e7680bf21 [rllib] Clean up concepts documentation and policy optimizer creation (#4592) 2019-04-12 21:03:26 -07:00
Romil BhardwajandRobert Nishihara 0f42f87ebc Updating zero capacity resource semantics (#4555) 2019-04-12 16:53:57 -07:00
cfanandEric Liang bb207a205b [rllib] Support torch device and distributions. (#4553) 2019-04-12 11:39:14 -07:00
Wang QingandHao Chen 5cfbfe5df6 [Java] Implement GcsClient (#4601) 2019-04-12 22:44:47 +08:00
Wang QingandYuhong Guo fe07a5b4b1 Add delete_creating_tasks option for internal.free() (#4588) 
* add delete creating task objects.

* format code style

* Fix lint

* add tests add address comments.

* Refine test

* Refine java test

* Fix CI

* Refine

* Fix lint

* Fix CI
 2019-04-12 13:38:31 +08:00
justinwyangandRobert Nishihara e88e706fcc Enforce quoting style in Travis. (#4589) 2019-04-11 14:24:26 -07:00
ppeagleandHao Chen 6697407ec4 [Java Streaming] Fix StreamSource constructor and SourceFunction initialization (#4597) 2019-04-10 20:02:11 +08:00
Kristian HartikainenandYuhong Guo ed02bf11f7 [autoscaler] Lint code that we forgot to lint in #4537 (#4584) 
* Lint code that we forgot to lint in previous PR

* Revert setup command merge

* Lint

* Revert "Revert setup command merge"

This reverts commit 55e1cdb1f256ea51ef66a38730d8f7865f1f5ad1.

* Fix testReportsConfigFailures test

* Minor syntax tweaks

* Lint
 2019-04-10 17:01:36 +08:00
Vlad FiroiuandEric Liang 74fd3d7e21 [rllib] Support prev_state/prev_action in rollout and fix multiagent (#4565) 
* Cleaner and more correct treatment of agent states in rollout.py

* support lstm_use_prev_action_reward in rollout.py

* Linter.

* appease flake8

* Use _DUMMY_AGENT_ID instead of 0.

* All agents have a policy_agent_mapping.
Reset the mapping cache at the start of each episode.

* Update rollout.py

* Fix rollout.py for single-agent envs.

* Use agent_id, not policy_id.
 2019-04-10 00:01:25 -07:00
Eric LiangandGitHub f8e8743347 [tune] Improve PBT example (#4575) 2019-04-09 20:59:17 -07:00
Si-YuanandGitHub dab99d26af Improve code related to node (#4383) 
* Make full use of node

implement local node

fix bugs mentioned in comments

* Add more tests

* Use more specific exception handling

* fix, lint

* fix for py2.x
 2019-04-09 17:27:54 +08:00
Wang QingandHao Chen c5bcec54f3 Add ignore items for java build (#4579) 2019-04-09 15:59:58 +08:00
Eric LiangandGitHub 4f46d3e9bf [rllib] Add multi-agent examples for hand-coded policy, centralized VF (#4554) 2019-04-09 00:36:49 -07:00
DuaneandRobert Nishihara 7f23e8431b fixed typo in kuber yaml (#4582) 2019-04-08 23:13:42 -07:00