9a8f29e571
YAPF, take 3 ( #2098 )
...
* Use pep8 style
The original style file is actually just pep8 style, but with everything
spelled out. It's easier to use the `based_on_style` feature. Any overrides are
clearer that way.
* Improve yapf script
1. Do formatting in parallel
2. Lint RLlib
3. Use .style.yapf file
* Pull out expressions into variables
* Don't format rllib
* Don't allow splits in dicts
* Apply yapf
* Disallow single line if-statements
* Use arithmetic comparison
* Simplify checking for changed files
* Pull out expr into var
2018-05-19 16:07:28 -07:00
8e0962bb9c
[rllib] rename async -> _async ( #2097 )
...
async and await are reserved words in Python 3.7, and will give a syntax error.
2018-05-19 14:16:52 -07:00
eba73449cc
fix unused lambda capture ( #2102 )
2018-05-19 13:27:10 -07:00
f1da721522
[xray] Use pubsub instead of timeout for ObjectManager Pull. ( #2079 )
...
Use pubsub instead of timeout for Pull.
2018-05-18 21:35:12 -07:00
9e46de9830
[DataFrame] Update _inherit_docstrings ( #2085 )
...
* Update _inherit_docstrings
* Add groupby __init__
2018-05-18 17:50:41 -10:00
5918776dd4
[JavaWorker] Changes to the build system for support java worker ( #2092 )
...
* Changes to the build system for support java worker
--------------------------
This commit includes changes to the build system, which is part of the java worker support of Ray.
It consists of the following changes:
- the changes of CMakeLists.txt files
- the changes of the python setup.py and init files for the adaptation of the changed build system
- move the location of local_scheduler_extension.cc for the adaptation of the changed build system which maybe better support multi-language worker
* minor whitespace
* Linting
2018-05-18 19:09:23 -07:00
71e5cca59f
[xray] Fix bug in updating actor execution dependencies ( #2064 )
...
* [xray] FIX: bugs in actor execution
* comments
* Stronger check
2018-05-18 12:45:17 -07:00
0b07602c89
[DataFrame] Refactor __delitem__ ( #2080 )
...
* Implement the bug fix
* Fix flake8
2018-05-18 08:58:20 -10:00
25e7aa1e79
[xray] Better error messaging when pulling from self. ( #2068 )
...
* complain more loudly when object pulls from self.
* Add checks for node manager, and internal checks for object manager.
* linting
2018-05-18 10:26:47 -07:00
57419f9132
Use source code in hash where possible ( fix #2089 ) ( #2090 )
2018-05-18 09:05:33 -07:00
78e4b021ab
Functions for flushing done tasks and evicted objects. ( #2033 )
2018-05-18 01:59:58 -07:00
15b72f9893
Fix compilation error for RAY_USE_NEW_GCS with latest clang. ( #2086 )
2018-05-17 23:10:02 -07:00
3c245f66d4
[xray] Corrects Error Handling During Push and Pull. ( #2059 )
...
* Makes bad status during Pull non-fatal.
Makes a bad status during Push fatal.
* pretty logs
* Stephanie's feedback.
2018-05-17 17:51:55 -07:00
6ca122f723
[xray] Sophisticated task dependency management ( #2035 )
2018-05-17 17:18:30 -07:00
470887c2ad
Support calling positional arguments by keyword ( fix #998 ) ( #2081 )
2018-05-17 16:10:26 -07:00
afbb260ca4
[DataFrame] Improve performance of iteration methods ( #2026 )
...
* fix iterrows
* make iteration methods performant
* resolving comments
* remove indexing from iterator
* switch to iterator syntax
2018-05-17 11:45:21 -10:00
ae17ebd032
[DataFrame] Implement to_csv ( #2014 )
...
* Add map, reduce, merge_dtypes
bug fixes
Unify dtypes on DataFrame creation
Formatting and comments
Cache dtypes
Fix bug in _merge_dtypes
Fix bug
Changed caching logic
Fix dtypes issue in read_csv
Invalidate dtypes cache when inserting column
Simplify unifying dtypes and improve caching
Fix typo
Better caching of dtypes
Fix merge conflicts
Implemented some to_csv functions
Support read_csv from buffers
Expose date_range, NaT, Timedelta from pandas
Add testing utils
Redirect imports to Pandas
Fix imports
Fix read_csv when index_col is specified
Update imports from Pandas
Fix bugs
Use util API
Fix nasty bug
Add missing import
Don't distribute reading of compressed files
Add test utilities for Pandas tests
Add test for to_csv
Add warnings
Fix rebase artifacts
* Fix rebase artifacts
* Fix bugs in read_csv indexing
* Fix bugs in read_csv
* Fix bug for IndexMetadata with _length 1
Remove testing imports
* Rebase artifacts and formatting
* Start to_csv without CSV formatter
* Fix bug in _map_partitions
* Initial implementation for improved to_csv
* Fix bug with insert
* Bugfixes
* Remove CSV Formatter
* Formatting
* Fix python2 bug
* Fix additional python2 issue
2018-05-17 11:35:17 -10:00
796864d887
[xray] Lineage cache only requests notifications about remote parent tasks ( #2066 )
...
* Only request notifications about a parent task that is remote
* Fix typo
* Fix lineage cache test
2018-05-17 13:01:40 -07:00
c0e4c9d3d1
[rllib] Add magic methods for rollouts ( #2024 )
2018-05-16 22:59:46 -07:00
7549209aea
[DataFrame] Allows DataFrame constructor to take in another DataFrame ( #2072 )
...
* allow constructor to take in other DataFrame
* rename _data to _frame_data
2018-05-16 16:17:20 -10:00
78bb887dd4
Pin Pandas version for Travis to 0.22 ( #2075 )
2018-05-16 15:05:37 -07:00
bea97b425b
Fix python linting ( #2076 )
2018-05-16 15:04:31 -07:00
88fa98e851
[xray] Fix GCS table prefixes ( #2065 )
...
* Fix GCS table prefixes
* More explicit documentation
2018-05-16 13:15:03 -07:00
570c3153cd
Some tests for _submit API. ( #2062 )
2018-05-16 00:26:25 -07:00
68bec0f6fb
[rllib] Queue lib for python 2.7 ( #2057 )
...
* Queue lib for python 2.7
* use six.moves.queue instead
2018-05-15 15:27:52 -07:00
3f1dd29eab
[autoscaler] Remove faulty assert that breaks during downscaling, pull configs from env ( #2006 )
...
* fixes
* coment out test
* Update ray_constants.py
* Update autoscaler_test.py
* Update ray_constants.py
* lint
* lint
2018-05-15 12:47:11 -07:00
825c227c2b
[DataFrame] Refactor indexers and implement setitem ( #2020 )
...
* Reset to_pandas change; update current
* Fix pd_df bug
2018-05-15 12:27:28 -07:00
79b45c6cfd
[rllib]Update bc/policy.py ( #2012 )
2018-05-15 11:52:24 -07:00
8fbb88485b
Create RemoteFunction class, remove FunctionProperties, simplify worker Python code. ( #2052 )
...
* Cleaning up worker and actor code. Create remote function class. Remove FunctionProperties object.
* Remove register_actor_signatures function.
* Small cleanups.
* Fix linting.
* Support @ray.method syntax for actor methods.
* Fix pickling bug.
* Fix linting.
* Shorten testBlockingTasks.
* Small fixes.
* Call get_global_worker().
2018-05-14 14:35:23 -07:00
ad48e47120
Don't crash on duplicate actor notifications ( #2043 )
2018-05-14 14:26:37 -07:00
19b743c84b
Fixed attribute name in code example ( #2054 )
...
hyperparam_mutations
2018-05-14 01:05:06 -07:00
52b0f3734a
[xray] Add Travis build for testing xray on Linux. ( #2047 )
...
* Run xray tests in travis.
* Comment out TaskTests.testSubmittingManyTasks.
* Comment out failing tests.
* Comment out hanging test.
* Linting
* Comment out failing test.
* Comment out failing test.
* Ignore test_dataframe.py for now.
* Comment out testDriverExitingQuickly.
2018-05-13 21:22:01 -07:00
4ff900e131
Added missing comma to code example ( #2050 )
2018-05-13 19:01:01 -07:00
18071d95a7
Use more CPUs for testMultipleWaitsAndGets. ( #2051 )
2018-05-13 15:35:02 -07:00
3ac0c08daa
use jobid_nil ( #2044 )
2018-05-13 14:22:09 -07:00
c7f3b8c4d3
Fix typo in tune. ( #2046 )
...
Fix typo in tune.
2018-05-12 09:36:45 -07:00
041c37506e
Fix error in api.rst. ( #2048 )
...
Fix error in api.rst.
2018-05-12 09:35:45 -07:00
71997a481b
Improve shared_ptr usage ( #2030 )
...
[xray] Improve shared_ptr usage
2018-05-11 20:05:04 -07:00
a292d7ba32
[xray] Fix UniqueID hashing for object and task IDs. ( #2017 )
...
* Skip object prefix in UniqueIDHasher, choose shard based on hash
* lint
2018-05-10 21:56:12 -07:00
89e2eef3f3
[DataFrame] Fixing bugs in groupby ( #2031 )
2018-05-10 11:44:19 -07:00
b79912ec74
[DataFrame] Fixes dropna subset bug ( #2018 )
...
* fix dropna
* resolve comment
2018-05-10 08:25:24 -07:00
72a3a6cb02
[DataFrame] Implement where ( #1989 )
2018-05-09 14:05:52 -07:00
d2c193ed2c
[DataFrame] Add direct pandas imports for MVP ( #1960 )
...
* Add direct pandas imports for MVP
* rebase artifact
2018-05-08 19:19:32 -07:00
77c8aa7627
Make ActorHandles pickleable, also make proper ActorHandle and ActorC… ( #2007 )
...
* Make ActorHandles pickleable, also make proper ActorHandle and ActorClass classes.
* Fix bug.
* Fix actor test bug.
* Update __ray_terminate__ usage.
* Fix most linting, add documentation, and small cleanups.
* Handle forking and pickling differently for actor handles. Fix linting.
* Fixes for named actors via pickling.
* Generate actor handle IDs deterministically in the pickling case.
2018-05-08 19:19:07 -07:00
2048b546ff
Expand local_dir in Trial init ( #2013 )
...
* Fix the case where Trial logs into wrong paths when `local_dir`
argument starts with tilde (~), by expanding the `local_dir` argument
* Add test case for checking that the tilde gets expanded
2018-05-07 21:44:28 -07:00
b1e32ca6c2
Fixing ascii error for Python2 ( #2009 )
2018-05-07 11:56:40 -07:00
1f82a46473
[DataFrame] Implements df.update ( #1997 )
...
* Working on fixing update
* Fixing update implementation
* Adding test
* Addressing comments
2018-05-07 08:55:40 -07:00
12da021717
[DataFrame] Implements df.as_matrix ( #2001 )
...
* Implement df.as_matrix
* Addressing comments
* Addressing comments
2018-05-06 23:36:39 -07:00
1848745223
[DataFrame] Implement quantile ( #1992 )
...
* added quantile method
* updated init for datetime signatures
* updated documentation for _map_partitions return type
* removed extraneous print call
* updated for simplicity
* fixed dtyping issues and error raising
* updated datetime dtype checking
* Fixing quantile implementation
* Fix minor bug
* Fixing diff
2018-05-06 18:25:13 -07:00
ad1afeb268
[DataFrame] Impement sort_values and sort_index ( #1977 )
2018-05-06 09:53:29 -07:00
Alok Singh