wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-16 11:21:10 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,181 Commits 36 Branches 42 Tags
9d4847ad2dfa013cb87ef68fa2cda82747b5f715
Commit Graph
2181 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Wang QingandRobert Nishihara 9d4847ad2d [hot-fix] Fix error when calling Ray.init() twice. (#3314) 2018-11-13 21:21:54 -05:00
Eric LiangandRichard Liaw 65c27c70cf [rllib] Clean up agent resource configurations (#3296) 
Closes #3284
 2018-11-13 18:00:03 -08:00
Philipp MoritzandRobert Nishihara d4fad222e1 Update profiling instructions for raylet (#3311) 2018-11-13 17:48:33 -05:00
Richard LiawandEric Liang 97f423781b Clean up Ray processes after cluster util exits (#3278) 2018-11-13 13:18:12 -08:00
Richard LiawandEric Liang c3a2c7ebed [tune] Doc: Autofilled, StatusReporter (#3294) 
* autofill and revise doc page for things

* lint

* comments
 2018-11-13 13:15:56 -08:00
Eric LiangandGitHub 6ee7a3b571 [rllib] Raise worker TF intra_op threads to 2, lower driver intra_op threads to 8 (#3299) 2018-11-13 11:41:58 -08:00
Richard LiawandPeter Schafhalter c0423db05c [core] Add Global State Test for multi-node setting (#3239) 
* add test for adding node

* multinode test fixes

* First pass at allowing updatable values

* Fix compilation issues

* Add config file parsing

* Full initialization

* Wrote a good test

* configuration parsing and stuff

* docs

* write some tests, make it good

* fixed init

* Add all config options and bring back stress tests.

* Update python/ray/worker.py

* Update python/ray/worker.py

* Fix internalization

* some last changes

* Linting and Java fix

* add docstring

* Fix test, add assertions

* pytest ext

* lint

* lint
 2018-11-13 10:35:24 -08:00
Eric LiangandRichard Liaw d90f365394 [rllib] Add self-supervised loss to model (#3291) 
# What do these changes do?

Allow self-supervised losses to be easily defined in custom models. Add this to the reference policy graphs.
 2018-11-12 18:55:24 -08:00
Philipp MoritzandRobert Nishihara ce6e01b988 enable incremental builds (#3292) 2018-11-12 21:49:09 -05:00
Eric LiangandGitHub bd0dbde149 [rllib] Rename ServingEnv => ExternalEnv (#3302) 2018-11-12 16:31:27 -08:00
Richard LiawandGitHub e37891d79d [tune] Fix default handling for timesteps (#3293) 
This PR fixes an issue where previously if timesteps_this_iter = 0,
then it would render as "None".

Closes #3057.
 2018-11-12 15:52:17 -08:00
Eric LiangandGitHub 49e2085d78 [rllib] Don't reset envs when possible (#3290) 
* laz

* better errors
 2018-11-11 01:45:37 -08:00
Eric LiangandGitHub 463511f8a6 [tune] Track and warn on low memory (#3298) 2018-11-11 00:29:45 -08:00
Eric LiangandGitHub 53489d2f85 [sgd] Document and add simple MNIST example (#3236) 2018-11-10 21:52:20 -08:00
IonandPhilipp Moritz d681893b0f Speed up task dispatch. (#3234) 
* speed up task dispatch

* minor changes

* improved comments

* improved comments

* change argument of DispatchTasks to list of tasks

* dispatch only tasks whose dependencies have been fullfiled

* some updated comments

* refactored DispatchQueue() and Assigntask() to avoid the copy of the ready list

* minor fixes

* some more minor fixes

* some more minor fixes

* added more comments

* better comments?

* fixed all feedback comments, minus making the argument of AssignTask() const

* Assigntask() now taskes a const argument

* Do the task copy outside of the callback

* fix linting
 2018-11-10 09:55:12 -08:00
Richard LiawandEric Liang 29c182d449 [tune] Support "None" for upload_dir 2018-11-09 22:02:08 -08:00
Eric LiangandGitHub a51d618d88 [autoscaler] missing example-full.yaml file in the latest wheel for provider type "local" 2018-11-09 21:25:15 -08:00
Eric LiangandRichard Liaw 9dd3eedbac [rllib] rollout.py should reduce num workers (#3263) 
## What do these changes do?

Don't create an excessive amount of workers for rollout.py, and also fix up the env wrapping to be consistent with the internal agent wrapper.

## Related issue number

Closes #3260.
 2018-11-09 12:29:16 -08:00
Richard LiawandGitHub 22113be04c [tune] Annotated Example Page and showcase Tutorials (#3267) 
Adds an example page and link in codebase.

Closes #2728.
 2018-11-08 23:45:05 -08:00
Eric LiangandPhilipp Moritz 588705b6fa [autoscaler] Add option to allow private ips only (#3270) 
* merge

* update

* upd

* Update python/ray/autoscaler/autoscaler.py

Co-Authored-By: ericl <ekhliang@gmail.com>

* Update python/ray/autoscaler/autoscaler.py

Co-Authored-By: ericl <ekhliang@gmail.com>

* Update python/ray/autoscaler/aws/config.py

Co-Authored-By: ericl <ekhliang@gmail.com>

* fix
 2018-11-08 17:07:31 -08:00
Philipp MoritzandRobert Nishihara 8894883153 Force kill web UI in ray stop (#3257) 2018-11-08 00:05:32 -08:00
Eric LiangandGitHub 9b2794101d [minor] Change chunk already exists to DEBUG, add flags for rllib multi node testing (#3228) 2018-11-08 00:04:20 -08:00
Stephanie WangandGitHub d950e92f63 Allow multiple threads to call ray.get and ray.wait (#3244) 
* Handle multiple threads calling ray.get

* Multithreaded ray.wait

* Pass in current task ID in java backend

* Add multithreaded actor to tests, add warning messages to worker for multithreaded ray.get

* Fix test

* Some cleanups

* Improve error message

* Add assertion

* Cleanup, throw error in HandleTaskUnblocked if task not actually blocked

* lint

* Fix python worker reset

* Fix references to reconstruct_objects

* Linting

* java lint

* Fix java

* Fix iterator
 2018-11-07 22:39:28 -08:00
Richard LiawandGitHub 0bab8ed95c Expose internal config parameters for starting Ray (#3246) 
## What do these changes do?

This PR exposes the CL option for using a config parameter. This is important for certain tests (i.e., FT tests that removing nodes) to run quickly.

Note that this is bad practice and should be replaced with GFLAGS or some equivalent as soon as possible.

#3239 depends on this.

TODO:
 - [x] Add documentation to method arguments before merging.
 - [x] Add test to verify this works?

## Related issue number
 2018-11-07 21:46:02 -08:00
Eric LiangandRichard Liaw 43df405d07 [rllib] Add some debug logs during agent setup (#3247) 2018-11-07 14:54:28 -08:00
Richard LiawandGitHub cf9e838326 [tune] Raise Error when overstepping (#3235) 2018-11-07 14:27:09 -08:00
Eric LiangandGitHub 29e3362905 Better errors on process deaths (#3252) 2018-11-07 14:08:16 -08:00
Robert NishiharaandPhilipp Moritz 1dd5d92789 Enable timeline visualizations of object transfers. (#3255) 
* Plot object transfers.

* Linting
 2018-11-07 12:45:59 -08:00
Philipp MoritzandStephanie Wang 4182b85611 Cache resources in SchedulingQueue (#3232) 
* cache resources

* fix

* documentation and remove old code

* fix PR

* update documentation

* linting
 2018-11-06 21:23:31 -08:00
Eric LiangandRobert Nishihara 2e04ffe00c Change dict serialization warning to debug (#3230) 2018-11-06 21:23:07 -08:00
Stephanie WangandRobert Nishihara ca585703b2 Refactor ObjectDirectory to reduce and fix callback usage (#3227) 2018-11-06 20:33:10 -08:00
eugenevinitskyandEric Liang 344b4ef0ff [rllib] Fix filter sync for ES and ARS (#2918) 2018-11-06 19:09:34 -08:00
Eric LiangandRobert Nishihara 725df3a485 Set the process title in workers and actors (#3219) 2018-11-06 14:59:22 -08:00
Peter SchafhalterandRobert Nishihara f3efcd2342 Fix password authentication in worker (#3124) 2018-11-06 13:40:03 -08:00
Eric LiangandGitHub 8356a01dd6 Remove suppressing duplicate error message (missed a couple) 2018-11-05 23:37:14 -08:00
Eric LiangandPhilipp Moritz 80f63696ac Cap object store memory to 20GB when size is None (#3243) 
* Update services.py

* Update services.py
 2018-11-05 18:34:19 -08:00
Wang QingandRobert Nishihara 4968cc5d70 Fix a small typo (#3240) 2018-11-05 18:30:53 -08:00
Stephanie WangandGitHub bf88aa5013 Increase timeout before reconstruction is triggered (#3217) 
* Increase timeout to 10s

* Skip eviction reconstruction tests

* Add stress test for many actors to one

* Fix test by shortening it.

* lower number of processes in stress test

* Skip slow test
 2018-11-05 18:03:50 -08:00
IonandPhilipp Moritz d8ae9de99c Caching task resource requirements. (#3231) 
* caching resource requirements

* small fixes

* avoid copying the resource map
 2018-11-05 15:14:09 -08:00
Eric LiangandRichard Liaw 813f51769f [rllib] Fix rllib rollouts script and add test (#3211) 
## What do these changes do?

Clean up the checkpointing to handle the new checkpoint dirs. Add a test for rollout.py

## Related issue number

https://github.com/ray-project/ray/issues/3206
https://github.com/ray-project/ray/issues/3204
 2018-11-05 00:33:25 -08:00
Philipp MoritzandRobert Nishihara 99bac44375 Update CMake to support Mac OS X 10.14 (#3218) 2018-11-04 16:32:58 -08:00
xutianmingandPhilipp Moritz fb6ac28b44 single sourcing the package version (#3220) 2018-11-04 13:53:55 -08:00
Eric LiangandGitHub 369cb833fe [rllib] Implement custom metrics (#3144) 2018-11-03 18:48:32 -07:00
Eric LiangandGitHub 7d69c77a19 [rllib] Decouple ape-x sampling and learning speed 2018-11-03 18:07:39 -07:00
Philipp MoritzandRobert Nishihara 0da15b1c1f Fix build system dependency for local_scheduler_client (#3215) 2018-11-03 13:19:02 -07:00
Eric LiangandRobert Nishihara 9a0f0db070 Add ray stack tool for debugging (#3213) 2018-11-03 13:13:02 -07:00
Wang QingandRobert Nishihara ca7d4c2cf5 Enable to specify driver id by user. (#3084) 2018-11-02 19:01:50 -07:00
Si-YuanandPhilipp Moritz 5ce7ed7dad Fix 'tempfile' docs (#3180) 
* Fix docs.

* Update doc/source/tempfile.rst

Co-Authored-By: suquark <suquark@gmail.com>

* Remove doc for raylet socket.
 2018-11-02 16:50:55 -07:00
Eric LiangandRobert Nishihara 8c03683573 Add warning about using latest wheels (#3207) 2018-11-02 15:41:10 -07:00
Robert NishiharaandPhilipp Moritz e495ab5e7c Fix some paths /tmp/raylogs -> /tmp/ray. (#3189) 2018-11-02 12:10:53 -07:00