wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-17 11:32:33 +08:00
Code Issues Packages Projects Releases Wiki Activity
5,715 Commits 36 Branches 42 Tags
54215ff287c034fe17c2aa1de5a8a67dc008dca1
Commit Graph
5715 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Peter SchafhalterandPhilipp Moritz 2a3b02649a Add queue test to xray tests (#2433) 2018-07-19 17:18:13 -07:00
Peter SchafhalterandPhilipp Moritz 400a3e5705 Add queue size and __len__ methods (#2432) 2018-07-19 17:04:42 -07:00
Peter SchafhalterandPhilipp Moritz 4225ac5081 Add benchmark using queue (#2431) 2018-07-19 16:43:22 -07:00
Eric LiangandGitHub 8e75d150f7 [rllib] Apex crash when compress_observations: False (#2426) 
We shouldn't try to decompress uncompressed data.

Also, fix resource requests for ddpg + GPU.
 2018-07-19 15:58:09 -07:00
Eric LiangandGitHub d01dc9e22d [rllib] format with yapf (#2427) 
* initial yapf

* manual fix yapf bugs
 2018-07-19 15:30:36 -07:00
Robert NishiharaandPeter Schafhalter 24eb140e07 Remove redundant reconstruct call. (#2421) 2018-07-19 11:22:02 -07:00
Robert NishiharaandPhilipp Moritz eed39163f9 Add callback to node manager for client removed event. (#2417) 
* Add callback to node manager for client removed event.

* Fix linting.
 2018-07-18 16:59:04 -07:00
Robert NishiharaandPhilipp Moritz 991d0911d1 Move profile data flushing to background thread on workers. (#2415) 
* Move profile data flushing to background thread on workers.

* Remove outdated comment.
 2018-07-18 12:34:53 -07:00
Philipp MoritzandRobert Nishihara 4c82ac72df Upgrade arrow to include the plasma TensorFlow op (#2412) 2018-07-18 12:33:02 -07:00
Wang QingandRobert Nishihara 344e3d2c05 Fix bug: Init RayLog before using it. (#2408) 2018-07-18 00:44:37 -07:00
Eric LiangandGitHub f31a6ca965 [rllib] Count actual sample batch size instead of configured batch size in A3C. (#2399) 
This fixes a metrics accounting bug where the sample count is not reported correctly.
 2018-07-18 08:59:52 +02:00
Richard LiawandGitHub 8e8c733696 [tune] Fix Categorical Space + Add Keras Example (#2401) 
Previously did not properly resolve categorical variables for HyperOpt.
 2018-07-17 23:52:52 +02:00
Yuhong GuoandPhilipp Moritz e3badb9b09 Fix that parquet and arrow will build every time. (#2405) 
* Fix the bug that parquet and arrow will build every time.

* Update build_arrow.sh

* Update build_arrow.sh
 2018-07-16 22:56:14 -07:00
Eric LiangandGitHub 0cecf6b79c [rllib] Cleanup RNN support and make it work with multi-GPU optimizer (#2394) 
Cleanup: TFPolicyGraph now automatically adds loss input entries for state_in_*, so that graph sub-classes don't need to worry about it.

Multi-GPU support:

Allow setting up model tower replicas with existing state input tensors

Truncate the per-device minibatch slices so that they are always a multiple of max_seq_len.
 2018-07-17 06:55:46 +02:00
Robert NishiharaandPhilipp Moritz 1b645fcc8b Add parameter server blog post. (#2398) 
* Saving work on parameter server blog post.

* Updates

* Updates to blog post.

* Add notes about tasks and actors.

* Updates

* Add RLlib paper link

* Update intro

* Address comments.

* More fixes.

* Clarify ray.get

* Change date

* Add @ray.remote clarification.

* Update site deployment instructions.

* Minor wording
 2018-07-16 21:51:39 -07:00
Peter SchafhalterandRobert Nishihara f5c46c7765 Add queue data structures (#2261) 2018-07-16 16:26:20 -07:00
Yuhong GuoandPhilipp Moritz 404bfc5da2 Add const to to_plasma_id function to make it usable by const ObjectID (#2404) 
* Add const to to_plasma_id to make it usable by const ObjectID

* Separate the building script to another PR.
 2018-07-16 11:05:51 -07:00
Yuhong GuoandPhilipp Moritz ded260b1b7 Add const to to_plasma_id function to make it usable by const ObjectID (#2404) 
* Add const to to_plasma_id to make it usable by const ObjectID

* Separate the building script to another PR.
 2018-07-16 11:05:37 -07:00
Yuhong GuoandPhilipp Moritz 206254bcf3 Add const to to_plasma_id function to make it usable by const ObjectID (#2404) 
* Add const to to_plasma_id to make it usable by const ObjectID

* Separate the building script to another PR.
 2018-07-16 11:05:29 -07:00
Hao ChenandRobert Nishihara 8a3e180156 Move profiling code to a new file and fix thread safety (#2397) 2018-07-15 18:09:52 -07:00
Yuhong GuoandPhilipp Moritz bbea73155a Fix parquet missing error and improve arrow commit id changing (#2319) 
* Fix parquet missing error and improve arrow commit id changing

* Remove build cache for arrow.

* Update build_parquet.sh

* Update build_ui.sh

* Update build_arrow.sh
 2018-07-14 16:08:13 -07:00
Eric LiangandRichard Liaw 7865dbab84 [tune] Raise error if incorrect key used in config (#2400) 2018-07-15 00:25:19 +02:00
Hao ChenandPhilipp Moritz c1575e98c1 Make local scheduler client thread-safe (#2386) 
* Make local scheduler client thread-safe for python

* lock write_messages

* remove allow-threads

* fix linter

* rename _write_message to do_write_message
 2018-07-13 16:19:00 -07:00
Eric LiangandRichard Liaw 62f84d2f07 [rllib] Restore TF soft placement config to fix multi-GPU optimizer (#2395) 2018-07-13 10:34:37 +02:00
Hao ChenandPhilipp Moritz d6af50785e move import_thread to a separate file (#2349) 
* move import_thread to a separate file

* sort imports

* group imports regardless of `from`

* re-organize imoprts based on google style

* Update import_thread.py

* fix event_type names in profile statement

* unify duplicate code
 2018-07-12 21:26:24 -07:00
CrystalandPhilipp Moritz ebf4070d88 Documentation- Basic Profiling for Ray Users (#2326) 
* Ray documentation - created new section 'Profiling for Ray Users', opposed to current Profiling section for Ray developers. Completed three sections 'A Basic Profiling Example', 'Timing Performance Using Python's Timestamps', and 'Profiling Using An External Profiler (Line_Profiler).' Left to-do two sections on CProfile and Ray Timeline Visualization.'

* Ray documentation - Fixed rst codeblock linebreaks in 'User Profiling'

* Ray documentation - For User Profiling, added section on cProfile

* Ray documentation - For User Profiling, completed Ray Timeline Visualization section, including graphical images

* Ray documentation - made User Profiling timeline image larger, minor wording edits

* Ray documentation - minor wording edits to User Profiling

* Ray documentation - User Profiling- fixed broken link

* Minor wording changes requested by Philipp Moritz addressed. Still need to address (1) compressing the image files, (2) correcting ex 3 to not be remote, and (3) using cProfile on an actor

* Ray documentation - For user-profiling.rst, revised example 3 to show a semi-parallelized example. Compressed timeline example image to be under 50 KB, removed view timeline GUI image. Updated timeline example image to reflect revised example 3. cProfile actor example left

* Ray documentation - in user-profiling.rst, added a new example including actors in the cProfile section

* Ray documentation - For user-profiling.rst, added section header for the Ray actor cProfile example

* Update user-profiling.rst

* Update user-profiling.rst

* 4 space indentation

* Update user-profiling.rst

* Update user-profiling.rst

* Update user-profiling.rst

* corrections
 2018-07-12 16:57:39 -07:00
Robert NishiharaandPhilipp Moritz 515da7721a Change ray.worker.cleanup -> ray.shutdown and improve API documentation. (#2374) 
* Change ray.worker.cleanup -> ray.shutdown and improve API documentation.

* Deprecate ray.worker.cleanup() gracefully.

* Fix linting
 2018-07-12 12:00:00 -07:00
Eric LiangandRichard Liaw b316afeb43 [rllib] Add debug info back to PPO and fix optimizer compatibility (#2366) 2018-07-12 19:22:46 +02:00
Eric LiangandGitHub 8ea926c266 [rllib] _init renamed to _build_layers in example 2018-07-12 19:21:58 +02:00
Richard LiawandGitHub 5188b1d080 [autoscaler] Bug for file mounts for tilde (#2382) 2018-07-12 19:18:47 +02:00
Richard LiawandGitHub 0048e77093 [rllib] RLlib CLI (#2375) 2018-07-12 19:12:04 +02:00
Robert NishiharaandPhilipp Moritz 54487b1d7f Pin the number of CPUs in failing actor test. (#2368) 
* Pin the number of CPUs in failing actor test.

* Pin number of CPUs in multi_node_test.py.

* Fix linting.
 2018-07-11 18:34:19 -07:00
Philipp MoritzandRobert Nishihara 4dadc60968 Update arrow to include uninitialized memory fixes (#2371) 2018-07-11 07:52:02 -05:00
Hanwei JinandPhilipp Moritz 450b11f1d6 update to slf4j, remove DynamicLog (#2384) 2018-07-09 23:33:59 -07:00
Richard LiawandRobert Nishihara 55d5e28872 [core] Better Actor Representation (#2369) 2018-07-09 11:20:21 -07:00
Zhijun FuandRobert Nishihara fa33ea5283 [Java] Java worker cluster support (#2359) 2018-07-09 10:20:41 -07:00
Eric LiangandGitHub 4ef9d15315 [rllib] Add concepts section of docs (#2373) 
This fills in the rllib concepts documentation.
 2018-07-08 18:46:52 -07:00
Richard LiawandGitHub 4d7da9f668 [rllib] Remove "Common", cleanup some code (#2348) 2018-07-08 13:03:53 -07:00
Zongheng YangandRobert Nishihara 1d05cd7077 Minor fix to 0.5 release blog post (#2377) 2018-07-08 00:38:31 -07:00
Robert NishiharaandPhilipp Moritz 2788376d8f Add 0.5 release notes. (#2365) 
* Add 0.5 release notes.

* Add note.

* Add note about Modin.

* Add vectorized environments note.

* Link to PR instead of commit.

* Add autoscaler link.

* syntax
 2018-07-07 17:31:13 -07:00
Robert NishiharaandPhilipp Moritz 35f4a3070c Update 0.4.0 to 0.5.0 in autoscaler and installation examples. (#2352) 2018-07-07 14:34:20 -07:00
Eric LiangandGitHub d24f19fd1e [rllib] Fix stats collection and some docs bugs since the refactoring (#2361) 
* fix

* fix pbt example

* fix

* fix

* single thread by default

* vec

* fix

* fix
 2018-07-07 13:29:20 -07:00
Eric LiangandRichard Liaw 9a6e329325 [rllib] Move repeat field to asv script (#2367) 2018-07-07 12:10:06 -07:00
Richard LiawandGitHub e32aed8717 [rllib] more user-friendly Optimizer signature + compute_apply (#2335) 
* Move signature of optimizers

* fix

* expose compute_apply for policy_graphs

* dictionaries and such

* test for multiagent
 2018-07-07 12:08:49 -07:00
Robert NishiharaandPhilipp Moritz e3534c46df [xray] Re-enable some stress tests and convert stress_tests to pytest. (#2285) 
* Fix one of the stress tests, fix ray.global_state.client_table when called early on.

* Re-enable testWait.

* Convert stress_tests.py to pytest.

* Fix
 2018-07-06 23:21:00 -07:00
Robert NishiharaandPhilipp Moritz 3a972893ee Bump version to 0.5.0. (#2351) ray-0.5.0 2018-07-06 22:31:33 -07:00
Philipp MoritzandRobert Nishihara e45bec1e51 Fix import error when tensorflow-gpu and tensorflow are both installed (#2364) 2018-07-06 22:29:54 -07:00
Philipp MoritzandRobert Nishihara fbde8cad74 Update apache arrow to include TensorFlow fix (#2345) 2018-07-06 13:18:56 -07:00
Devin PetersohnandRobert Nishihara 4185aaed10 Dataframe deprecation (#2353) 2018-07-06 00:16:22 -07:00
Philipp MoritzandRobert Nishihara 4f1d14e176 improve error message when flex or bison is not installed (#2355) 2018-07-05 23:46:55 -07:00