Stephanie Wang and GitHub
71e5cca59f
[xray] Fix bug in updating actor execution dependencies ( #2064 )
...
* [xray] FIX: bugs in actor execution
* comments
* Stronger check
2018-05-18 12:45:17 -07:00
Simon Mo and Devin Petersohn
0b07602c89
[DataFrame] Refactor __delitem__ ( #2080 )
...
* Implement the bug fix
* Fix flake8
2018-05-18 08:58:20 -10:00
Melih Elibol and Philipp Moritz
25e7aa1e79
[xray] Better error messaging when pulling from self. ( #2068 )
...
* complain more loudly when object pulls from self.
* Add checks for node manager, and internal checks for object manager.
* linting
2018-05-18 10:26:47 -07:00
Adam Gleave and Robert Nishihara
57419f9132
Use source code in hash where possible ( fix #2089 ) ( #2090 )
2018-05-18 09:05:33 -07:00
Robert Nishihara and Philipp Moritz
78e4b021ab
Functions for flushing done tasks and evicted objects. ( #2033 )
2018-05-18 01:59:58 -07:00
Robert Nishihara and Zongheng Yang
15b72f9893
Fix compilation error for RAY_USE_NEW_GCS with latest clang. ( #2086 )
2018-05-17 23:10:02 -07:00
Melih Elibol and Philipp Moritz
3c245f66d4
[xray] Corrects Error Handling During Push and Pull. ( #2059 )
...
* Makes bad status during Pull non-fatal.
Makes a bad status during Push fatal.
* pretty logs
* Stephanie's feedback.
2018-05-17 17:51:55 -07:00
Stephanie Wang and Robert Nishihara
6ca122f723
[xray] Sophisticated task dependency management ( #2035 )
2018-05-17 17:18:30 -07:00
Adam Gleave and Robert Nishihara
470887c2ad
Support calling positional arguments by keyword ( fix #998 ) ( #2081 )
2018-05-17 16:10:26 -07:00
Kunal Gosar and Devin Petersohn
afbb260ca4
[DataFrame] Improve performance of iteration methods ( #2026 )
...
* fix iterrows
* make iteration methods performant
* resolving comments
* remove indexing from iterator
* switch to iterator syntax
2018-05-17 11:45:21 -10:00
Peter Schafhalter and Devin Petersohn
ae17ebd032
[DataFrame] Implement to_csv ( #2014 )
...
* Add map, reduce, merge_dtypes
bug fixes
Unify dtypes on DataFrame creation
Formatting and comments
Cache dtypes
Fix bug in _merge_dtypes
Fix bug
Changed caching logic
Fix dtypes issue in read_csv
Invalidate dtypes cache when inserting column
Simplify unifying dtypes and improve caching
Fix typo
Better caching of dtypes
Fix merge conflicts
Implemented some to_csv functions
Support read_csv from buffers
Expose date_range, NaT, Timedelta from pandas
Add testing utils
Redirect imports to Pandas
Fix imports
Fix read_csv when index_col is specified
Update imports from Pandas
Fix bugs
Use util API
Fix nasty bug
Add missing import
Don't distribute reading of compressed files
Add test utilities for Pandas tests
Add test for to_csv
Add warnings
Fix rebase artifacts
* Fix rebase artifacts
* Fix bugs in read_csv indexing
* Fix bugs in read_csv
* Fix bug for IndexMetadata with _length 1
Remove testing imports
* Rebase artifacts and formatting
* Start to_csv without CSV formatter
* Fix bug in _map_partitions
* Initial implementation for improved to_csv
* Fix bug with insert
* Bugfixes
* Remove CSV Formatter
* Formatting
* Fix python2 bug
* Fix additional python2 issue
2018-05-17 11:35:17 -10:00
Stephanie Wang and GitHub
796864d887
[xray] Lineage cache only requests notifications about remote parent tasks ( #2066 )
...
* Only request notifications about a parent task that is remote
* Fix typo
* Fix lineage cache test
2018-05-17 13:01:40 -07:00
Alok Singh and Richard Liaw
c0e4c9d3d1
[rllib] Add magic methods for rollouts ( #2024 )
2018-05-16 22:59:46 -07:00
Kunal Gosar and Devin Petersohn
7549209aea
[DataFrame] Allows DataFrame constructor to take in another DataFrame ( #2072 )
...
* allow constructor to take in other DataFrame
* rename _data to _frame_data
2018-05-16 16:17:20 -10:00
Peter Schafhalter and Robert Nishihara
78bb887dd4
Pin Pandas version for Travis to 0.22 ( #2075 )
2018-05-16 15:05:37 -07:00
Melih Elibol and Robert Nishihara
bea97b425b
Fix python linting ( #2076 )
2018-05-16 15:04:31 -07:00
Stephanie Wang and GitHub
88fa98e851
[xray] Fix GCS table prefixes ( #2065 )
...
* Fix GCS table prefixes
* More explicit documentation
2018-05-16 13:15:03 -07:00
Robert Nishihara and Philipp Moritz
570c3153cd
Some tests for _submit API. ( #2062 )
2018-05-16 00:26:25 -07:00
alexbao and Richard Liaw
68bec0f6fb
[rllib] Queue lib for python 2.7 ( #2057 )
...
* Queue lib for python 2.7
* use six.moves.queue instead
2018-05-15 15:27:52 -07:00
Eric Liang and GitHub
3f1dd29eab
[autoscaler] Remove faulty assert that breaks during downscaling, pull configs from env ( #2006 )
...
* fixes
* coment out test
* Update ray_constants.py
* Update autoscaler_test.py
* Update ray_constants.py
* lint
* lint
2018-05-15 12:47:11 -07:00
Simon Mo and Devin Petersohn
825c227c2b
[DataFrame] Refactor indexers and implement setitem ( #2020 )
...
* Reset to_pandas change; update current
* Fix pd_df bug
2018-05-15 12:27:28 -07:00
SunYiran and Richard Liaw
79b45c6cfd
[rllib]Update bc/policy.py ( #2012 )
2018-05-15 11:52:24 -07:00
Robert Nishihara and Philipp Moritz
8fbb88485b
Create RemoteFunction class, remove FunctionProperties, simplify worker Python code. ( #2052 )
...
* Cleaning up worker and actor code. Create remote function class. Remove FunctionProperties object.
* Remove register_actor_signatures function.
* Small cleanups.
* Fix linting.
* Support @ray.method syntax for actor methods.
* Fix pickling bug.
* Fix linting.
* Shorten testBlockingTasks.
* Small fixes.
* Call get_global_worker().
2018-05-14 14:35:23 -07:00
Stephanie Wang and Robert Nishihara
ad48e47120
Don't crash on duplicate actor notifications ( #2043 )
2018-05-14 14:26:37 -07:00
Ken Fehling and Eric Liang
19b743c84b
Fixed attribute name in code example ( #2054 )
...
hyperparam_mutations
2018-05-14 01:05:06 -07:00
Robert Nishihara and Philipp Moritz
52b0f3734a
[xray] Add Travis build for testing xray on Linux. ( #2047 )
...
* Run xray tests in travis.
* Comment out TaskTests.testSubmittingManyTasks.
* Comment out failing tests.
* Comment out hanging test.
* Linting
* Comment out failing test.
* Comment out failing test.
* Ignore test_dataframe.py for now.
* Comment out testDriverExitingQuickly.
2018-05-13 21:22:01 -07:00
Ken Fehling and Robert Nishihara
4ff900e131
Added missing comma to code example ( #2050 )
2018-05-13 19:01:01 -07:00
Robert Nishihara and Philipp Moritz
18071d95a7
Use more CPUs for testMultipleWaitsAndGets. ( #2051 )
2018-05-13 15:35:02 -07:00
Melih Elibol and Philipp Moritz
3ac0c08daa
use jobid_nil ( #2044 )
2018-05-13 14:22:09 -07:00
Alok Singh and Robert Nishihara
c7f3b8c4d3
Fix typo in tune. ( #2046 )
...
Fix typo in tune.
2018-05-12 09:36:45 -07:00
Aris L and Robert Nishihara
041c37506e
Fix error in api.rst. ( #2048 )
...
Fix error in api.rst.
2018-05-12 09:35:45 -07:00
eric-jj and Philipp Moritz
71997a481b
Improve shared_ptr usage ( #2030 )
...
[xray] Improve shared_ptr usage
2018-05-11 20:05:04 -07:00
Stephanie Wang and GitHub
a292d7ba32
[xray] Fix UniqueID hashing for object and task IDs. ( #2017 )
...
* Skip object prefix in UniqueIDHasher, choose shard based on hash
* lint
2018-05-10 21:56:12 -07:00
Devin Petersohn and Robert Nishihara
89e2eef3f3
[DataFrame] Fixing bugs in groupby ( #2031 )
2018-05-10 11:44:19 -07:00
Kunal Gosar and Devin Petersohn
b79912ec74
[DataFrame] Fixes dropna subset bug ( #2018 )
...
* fix dropna
* resolve comment
2018-05-10 08:25:24 -07:00
Devin Petersohn and Robert Nishihara
72a3a6cb02
[DataFrame] Implement where ( #1989 )
2018-05-09 14:05:52 -07:00
Kunal Gosar and Devin Petersohn
d2c193ed2c
[DataFrame] Add direct pandas imports for MVP ( #1960 )
...
* Add direct pandas imports for MVP
* rebase artifact
2018-05-08 19:19:32 -07:00
Robert Nishihara and Philipp Moritz
77c8aa7627
Make ActorHandles pickleable, also make proper ActorHandle and ActorC… ( #2007 )
...
* Make ActorHandles pickleable, also make proper ActorHandle and ActorClass classes.
* Fix bug.
* Fix actor test bug.
* Update __ray_terminate__ usage.
* Fix most linting, add documentation, and small cleanups.
* Handle forking and pickling differently for actor handles. Fix linting.
* Fixes for named actors via pickling.
* Generate actor handle IDs deterministically in the pickling case.
2018-05-08 19:19:07 -07:00
Kristian Hartikainen and Richard Liaw
2048b546ff
Expand local_dir in Trial init ( #2013 )
...
* Fix the case where Trial logs into wrong paths when `local_dir`
argument starts with tilde (~), by expanding the `local_dir` argument
* Add test case for checking that the tilde gets expanded
2018-05-07 21:44:28 -07:00
Devin Petersohn and Robert Nishihara
b1e32ca6c2
Fixing ascii error for Python2 ( #2009 )
2018-05-07 11:56:40 -07:00
Peter Veerman and Devin Petersohn
1f82a46473
[DataFrame] Implements df.update ( #1997 )
...
* Working on fixing update
* Fixing update implementation
* Adding test
* Addressing comments
2018-05-07 08:55:40 -07:00
Peter Veerman and Devin Petersohn
12da021717
[DataFrame] Implements df.as_matrix ( #2001 )
...
* Implement df.as_matrix
* Addressing comments
* Addressing comments
2018-05-06 23:36:39 -07:00
Rohan Singh and Devin Petersohn
1848745223
[DataFrame] Implement quantile ( #1992 )
...
* added quantile method
* updated init for datetime signatures
* updated documentation for _map_partitions return type
* removed extraneous print call
* updated for simplicity
* fixed dtyping issues and error raising
* updated datetime dtype checking
* Fixing quantile implementation
* Fix minor bug
* Fixing diff
2018-05-06 18:25:13 -07:00
Devin Petersohn and Robert Nishihara
ad1afeb268
[DataFrame] Impement sort_values and sort_index ( #1977 )
2018-05-06 09:53:29 -07:00
Rohan Singh and Devin Petersohn
9f28529e2c
[DataFrame] Implement rank ( #1991 )
...
* rank method completed
* added sanity checks
* flake8
* updated sanity checks
* flake8
* updated sanity checks and style
* updated dtype logic
* Fixing test
2018-05-06 09:32:33 -07:00
Hari Subbaraj and Devin Petersohn
857458c37c
[DataFrame] Implemented prod, product, added test suite ( #1994 )
...
* implemented prod/product, modified declaration for sum, added pandas test suite
* fixed tests
* removed test_analytics file
* implemented nunique, skew
* fixed requested changes
* added nunique, skew
* fixed tests in request
* added newline back
* fixed newlines hopefully
* fixed flake8 issues
* more flake8 issues
* fixed test for prod
2018-05-05 21:25:42 -07:00
Jae Min Kim and Devin Petersohn
36fd64800b
[DataFrame] Implemented __setitem__, select_dtypes, and astype ( #1941 )
...
* added reindex, __setitem__, select_dtypes, and astype functionality
* readded tests for astype and select_dtypes
* fixed index issue with reindex
* lint spacing
* removing current reindex implementation for future pr
* wrong testing func
* errors now raised in the workers, but suppressing them can be an issue
* updated code for select_dtypes
* Update test_dataframe.py
2018-05-05 20:27:29 -07:00
Rohan Singh and Devin Petersohn
8509a51291
[DataFrame] Implement diff ( #1996 )
...
* added diff method
* sanity checks
* flake8
* updated sanity checks'
* rebase and style updates
* updated diff tests and cleaned up code
* updated tests for periods
* flake8
2018-05-05 00:44:52 -07:00
Hari Subbaraj and Devin Petersohn
a58629f53f
[DataFrame] Implemented nunique, skew ( #1995 )
...
* implemented prod/product, modified declaration for sum, added pandas test suite
* fixed tests
* removed test_analytics file
* implemented nunique, skew
* fixed changes for nunique, skew
* fixed nunique test
* added axis=1 test to skew
* flake8 issues
* more flake8 issues
* resolve some flake issues
2018-05-04 12:22:10 -07:00
Kunal Gosar and Devin Petersohn
4030356b51
[DataFrame] Implements filter and dropna ( #1959 )
...
* implement filter
* begin implementation of dropna
* implement dropna
* docs and tests
* resolving comments
* resolving merge
* add error checking to dropna
* fix update inplace call
* Implement multiple axis for dropna (#13 )
* Implement multiple axis for dropna
* Add multiple axis dropna test
* Fix using dummy_frame in dropna
* Clean up dropna multiple axis tests
* remove unnecessary axis modification
* Clean up dropna tests
* resolve comments
* fix lint
2018-05-04 12:21:16 -07:00
