wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-15 11:25:40 +08:00
Code Issues Packages Projects Releases Wiki Activity
1,655 Commits 36 Branches 42 Tags
5c2b2c7b4977aca2c74d1808cd2df25b3e4f7697
Commit Graph
1655 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Yujie LiuandRobert Nishihara 5c2b2c7b49 [JavaWorker] Changes to the directory under src for support java worker (#2093) 
* Changes to the directory under src for support java worker
--------------------------
This commit includes changes to the directory under src, which is part of the java worker support of Ray.
It consists of the following changes:
 src/common/task.cc - just fix null point problem
 org_ray_spi_impl_DefaultLocalSchedulerClient.* - JNI support for local scheduler client, and the org_ray_spi_impl_DefaultLocalSchedulerClient.cc file is not autogenerated
 2018-05-25 00:59:05 -07:00
Zongheng YangandRobert Nishihara fa97acbc89 Integrate credis with Ray & route task table entries into credis. (#1841) 2018-05-24 23:35:25 -07:00
Yucong HeandRobert Nishihara 3509a33cf3 Prototype named actors. (#2129) 2018-05-24 00:32:12 -07:00
Philipp MoritzandRobert Nishihara 225608ec66 Update arrow to latest master (#2100) 2018-05-24 00:26:13 -07:00
Peter SchafhalterandDevin Petersohn 68b11c8251 [DataFrame] Speed up dtypes (#2118) 
* Don't recreate _block_partitions in _correct_dtypes

Further dtypes performance optimizations

Fix bugs

Redesign speedup

Address feedback

* Remove _correct_column_dtypes
 2018-05-23 16:35:17 -07:00
yuyimingandRobert Nishihara 9ff3d57429 do not fetch from dead Plasma Manager (#2116) 2018-05-23 16:13:09 -07:00
Kunal GosarandDevin Petersohn 4584193308 [DataFrame] Refactor GroupBy Methods and Implement Reindex (#2101) 
* fix 1D blocks case

* Add groupby test code

* begin writing tests

* Fix bug on groupby(axis=1, ...)

* implement reindex

* fix index misalignment after groupby

* fix df.apply bug

* fix groupby.apply

* fix agg funcs

* finish groupby tests

* finish test suite for groupby

* fixing lint

* undo new line

* fix python2 index copy bug

* Concat Series into ray.df

* fixing python2 issues

* resolving all python 2 tests

* handle multiindex on apply

* resolve comments

* updating docstring

* fix lint

* fix lint again

* address comments
 2018-05-22 16:34:07 -07:00
Richard LiawandPhilipp Moritz 01f69689ed Initial Support for Airspeed Velocity (#2113) 
* asv init

* move asv

* init benchmarks

* small changes

* running basics

* ok done

* readme

* ok

* update

* linting

* linting

* linting

* linting

* Update and rename README-benchmarks.md to README-benchmarks.rst

* Update benchmarks.py

* linting
 2018-05-22 16:20:39 -07:00
Robert NishiharaandPhilipp Moritz 9b9ff19dd0 Use automatic memory management in Redis modules. (#1797) 2018-05-22 01:05:09 -07:00
Devin PetersohnandRobert Nishihara 317c9450e7 [DataFrame] Test bugfixes (#2111) 2018-05-21 23:01:19 -07:00
Peter SchafhalterandDevin Petersohn f1fc373de7 [DataFrame] Update initializations of IndexMetadata which use outdated APIs (#2103) 
* Update calls which use outdated APIs

* Fix lengths of IndexMetadata
 2018-05-21 09:19:41 -10:00
eric-jjandRobert Nishihara eb078766d8 Performance fix (#2110) 2018-05-20 18:07:55 -07:00
Alok SinghandPhilipp Moritz f795173b51 Use flake8-comprehensions (#1976) 
* Add flake8 to Travis

* Add flake8-comprehensions

[flake8 plugin](https://github.com/adamchainz/flake8-comprehensions) that
checks for useless constructions.

* Use generators instead of lists where appropriate

A lot of the builtins can take in generators instead of lists.

This commit applies `flake8-comprehensions` to find them.

* Fix lint error

* Fix some string formatting

The rest can be fixed in another PR

* Fix compound literals syntax

This should probably be merged after #1963.

* dict() -> {}

* Use dict literal syntax

dict(...) -> {...}

* Rewrite nested dicts

* Fix hanging indent

* Add missing import

* Add missing quote

* fmt

* Add missing whitespace

* rm duplicate pip install

This is already installed in another file.

* Fix indent

* move `merge_dicts` into utils

* Bring up to date with `master`

* Add automatic syntax upgrade

* rm pyupgrade

In case users want to still use it on their own, the upgrade-syn.sh script was
left in the `.travis` dir.
 2018-05-20 16:15:06 -07:00
Robert NishiharaandPhilipp Moritz 99ae74e1d2 Improve error message printing and suppression. (#2104) 2018-05-20 12:13:14 -07:00
Eric LiangandGitHub f37e2e5d2f [rllib] [doc] Broken link in ddpg doc 2018-05-20 00:10:59 -07:00
Alok SinghandRichard Liaw 9a8f29e571 YAPF, take 3 (#2098) 
* Use pep8 style

The original style file is actually just pep8 style, but with everything
spelled out. It's easier to use the `based_on_style` feature. Any overrides are
clearer that way.

* Improve yapf script

1. Do formatting in parallel
2. Lint RLlib
3. Use .style.yapf file

* Pull out expressions into variables

* Don't format rllib

* Don't allow splits in dicts

* Apply yapf

* Disallow single line if-statements

* Use arithmetic comparison

* Simplify checking for changed files

* Pull out expr into var
 2018-05-19 16:07:28 -07:00
Alok SinghandRobert Nishihara 8e0962bb9c [rllib] rename async -> _async (#2097) 
async and await are reserved words in Python 3.7, and will give a syntax error.
 2018-05-19 14:16:52 -07:00
Kunal GosarandRobert Nishihara eba73449cc fix unused lambda capture (#2102) 2018-05-19 13:27:10 -07:00
Melih ElibolandGitHub f1da721522 [xray] Use pubsub instead of timeout for ObjectManager Pull. (#2079) 
Use pubsub instead of timeout for Pull.
 2018-05-18 21:35:12 -07:00
Peter SchafhalterandDevin Petersohn 9e46de9830 [DataFrame] Update _inherit_docstrings (#2085) 
* Update _inherit_docstrings

* Add groupby __init__
 2018-05-18 17:50:41 -10:00
Yujie LiuandPhilipp Moritz 5918776dd4 [JavaWorker] Changes to the build system for support java worker (#2092) 
* Changes to the build system for support java worker
--------------------------
This commit includes changes to the build system, which is part of the java worker support of Ray.
It consists of the following changes:
 - the changes of CMakeLists.txt files
 - the changes of the python setup.py and init files for the adaptation of the changed build system
 - move the location of local_scheduler_extension.cc for the adaptation of the changed build system which maybe better support multi-language worker

* minor whitespace

* Linting
 2018-05-18 19:09:23 -07:00
Stephanie WangandGitHub 71e5cca59f [xray] Fix bug in updating actor execution dependencies (#2064) 
* [xray] FIX: bugs in actor execution

* comments

* Stronger check
 2018-05-18 12:45:17 -07:00
Simon MoandDevin Petersohn 0b07602c89 [DataFrame] Refactor __delitem__ (#2080) 
* Implement the bug fix

* Fix flake8
 2018-05-18 08:58:20 -10:00
Melih ElibolandPhilipp Moritz 25e7aa1e79 [xray] Better error messaging when pulling from self. (#2068) 
* complain more loudly when object pulls from self.

* Add checks for node manager, and internal checks for object manager.

* linting
 2018-05-18 10:26:47 -07:00
Adam GleaveandRobert Nishihara 57419f9132 Use source code in hash where possible (fix #2089) (#2090) 2018-05-18 09:05:33 -07:00
Robert NishiharaandPhilipp Moritz 78e4b021ab Functions for flushing done tasks and evicted objects. (#2033) 2018-05-18 01:59:58 -07:00
Robert NishiharaandZongheng Yang 15b72f9893 Fix compilation error for RAY_USE_NEW_GCS with latest clang. (#2086) 2018-05-17 23:10:02 -07:00
Melih ElibolandPhilipp Moritz 3c245f66d4 [xray] Corrects Error Handling During Push and Pull. (#2059) 
* Makes bad status during Pull non-fatal.
Makes a bad status during Push fatal.

* pretty logs

* Stephanie's feedback.
 2018-05-17 17:51:55 -07:00
Stephanie WangandRobert Nishihara 6ca122f723 [xray] Sophisticated task dependency management (#2035) 2018-05-17 17:18:30 -07:00
Adam GleaveandRobert Nishihara 470887c2ad Support calling positional arguments by keyword (fix #998) (#2081) 2018-05-17 16:10:26 -07:00
Kunal GosarandDevin Petersohn afbb260ca4 [DataFrame] Improve performance of iteration methods (#2026) 
* fix iterrows

* make iteration methods performant

* resolving comments

* remove indexing from iterator

* switch to iterator syntax
 2018-05-17 11:45:21 -10:00
Peter SchafhalterandDevin Petersohn ae17ebd032 [DataFrame] Implement to_csv (#2014) 
* Add map, reduce, merge_dtypes

bug fixes

Unify dtypes on DataFrame creation

Formatting and comments

Cache dtypes

Fix bug in _merge_dtypes

Fix bug

Changed caching logic

Fix dtypes issue in read_csv

Invalidate dtypes cache when inserting column

Simplify unifying dtypes and improve caching

Fix typo

Better caching of dtypes

Fix merge conflicts

Implemented some to_csv functions

Support read_csv from buffers

Expose date_range, NaT, Timedelta from pandas

Add testing utils

Redirect imports to Pandas

Fix imports

Fix read_csv when index_col is specified

Update imports from Pandas

Fix bugs

Use util API

Fix nasty bug

Add missing import

Don't distribute reading of compressed files

Add test utilities for Pandas tests

Add test for to_csv

Add warnings

Fix rebase artifacts

* Fix rebase artifacts

* Fix bugs in read_csv indexing

* Fix bugs in read_csv

* Fix bug for IndexMetadata with _length 1

Remove testing imports

* Rebase artifacts and formatting

* Start to_csv without CSV formatter

* Fix bug in _map_partitions

* Initial implementation for improved to_csv

* Fix bug with insert

* Bugfixes

* Remove CSV Formatter

* Formatting

* Fix python2 bug

* Fix additional python2 issue
 2018-05-17 11:35:17 -10:00
Stephanie WangandGitHub 796864d887 [xray] Lineage cache only requests notifications about remote parent tasks (#2066) 
* Only request notifications about a parent task that is remote

* Fix typo

* Fix lineage cache test
 2018-05-17 13:01:40 -07:00
Alok SinghandRichard Liaw c0e4c9d3d1 [rllib] Add magic methods for rollouts (#2024) 2018-05-16 22:59:46 -07:00
Kunal GosarandDevin Petersohn 7549209aea [DataFrame] Allows DataFrame constructor to take in another DataFrame (#2072) 
* allow constructor to take in other DataFrame

* rename _data to _frame_data
 2018-05-16 16:17:20 -10:00
Peter SchafhalterandRobert Nishihara 78bb887dd4 Pin Pandas version for Travis to 0.22 (#2075) 2018-05-16 15:05:37 -07:00
Melih ElibolandRobert Nishihara bea97b425b Fix python linting (#2076) 2018-05-16 15:04:31 -07:00
Stephanie WangandGitHub 88fa98e851 [xray] Fix GCS table prefixes (#2065) 
* Fix GCS table prefixes

* More explicit documentation
 2018-05-16 13:15:03 -07:00
Robert NishiharaandPhilipp Moritz 570c3153cd Some tests for _submit API. (#2062) 2018-05-16 00:26:25 -07:00
alexbaoandRichard Liaw 68bec0f6fb [rllib] Queue lib for python 2.7 (#2057) 
* Queue lib for python 2.7

* use six.moves.queue instead
 2018-05-15 15:27:52 -07:00
Eric LiangandGitHub 3f1dd29eab [autoscaler] Remove faulty assert that breaks during downscaling, pull configs from env (#2006) 
* fixes

* coment out test

* Update ray_constants.py

* Update autoscaler_test.py

* Update ray_constants.py

* lint

* lint
 2018-05-15 12:47:11 -07:00
Simon MoandDevin Petersohn 825c227c2b [DataFrame] Refactor indexers and implement setitem (#2020) 
* Reset to_pandas change; update current

* Fix pd_df bug
 2018-05-15 12:27:28 -07:00
SunYiranandRichard Liaw 79b45c6cfd [rllib]Update bc/policy.py (#2012) 2018-05-15 11:52:24 -07:00
Robert NishiharaandPhilipp Moritz 8fbb88485b Create RemoteFunction class, remove FunctionProperties, simplify worker Python code. (#2052) 
* Cleaning up worker and actor code. Create remote function class. Remove FunctionProperties object.

* Remove register_actor_signatures function.

* Small cleanups.

* Fix linting.

* Support @ray.method syntax for actor methods.

* Fix pickling bug.

* Fix linting.

* Shorten testBlockingTasks.

* Small fixes.

* Call get_global_worker().
 2018-05-14 14:35:23 -07:00
Stephanie WangandRobert Nishihara ad48e47120 Don't crash on duplicate actor notifications (#2043) 2018-05-14 14:26:37 -07:00
Ken FehlingandEric Liang 19b743c84b Fixed attribute name in code example (#2054) 
hyperparam_mutations
 2018-05-14 01:05:06 -07:00
Robert NishiharaandPhilipp Moritz 52b0f3734a [xray] Add Travis build for testing xray on Linux. (#2047) 
* Run xray tests in travis.

* Comment out TaskTests.testSubmittingManyTasks.

* Comment out failing tests.

* Comment out hanging test.

* Linting

* Comment out failing test.

* Comment out failing test.

* Ignore test_dataframe.py for now.

* Comment out testDriverExitingQuickly.
 2018-05-13 21:22:01 -07:00
Ken FehlingandRobert Nishihara 4ff900e131 Added missing comma to code example (#2050) 2018-05-13 19:01:01 -07:00
Robert NishiharaandPhilipp Moritz 18071d95a7 Use more CPUs for testMultipleWaitsAndGets. (#2051) 2018-05-13 15:35:02 -07:00
Melih ElibolandPhilipp Moritz 3ac0c08daa use jobid_nil (#2044) 2018-05-13 14:22:09 -07:00