* added reindex, __setitem__, select_dtypes, and astype functionality
* readded tests for astype and select_dtypes
* fixed index issue with reindex
* lint spacing
* removing current reindex implementation for future pr
* wrong testing func
* errors now raised in the workers, but suppressing them can be an issue
* updated code for select_dtypes
* Update test_dataframe.py
* Add empty df test
* Fix flake8 issues
* rebase with master
* reset master tests
* Implement df.pipe
* fix tests
* Use test_pipe as a pytest.fixture
* Add newline at EOF
* working for non-string functions and not lists of functions
* works with functions as strings now as well
* fixed linting errors
* throwing a warning if the input is a dictionary
* added dict of lists functionality
* fix minor indexing errors and lint
* removed some commented out code
* some comments and thoughts for apply
* cleaned up code a little bit and added todos
* improved performance
* error checking and code cleanup and comments
* small change
* improved list performance a lot
* agg calls apply for lists
* addressing comments on the PR
* col_metadata change
* updated tests to expect TypeError where appropriate
* Use set/dict literal syntax
Ran code through [pyupgrade](https://github.com/asottile/pyupgrade). This is
supported in every Python version 2.7+.
* Drop unnecessary string format specification
No need to specify 0,1.. if paramters are passed in order.
* Revert "Drop unnecessary string format specification"
This reverts commit efa5ec85d30ff69f34e5ed93e31343fea7647bcb.
* Undo changes to cloudpickle
Drop use of set literal until cloudpickle uses it.
* Reformat code with YAPF
We need to set up a git pre-push hook to automatically run this stuff.
* Begin merge implementation
* Some cleanup
* Continue cleanup
* Allowing merge on index
* Copy dataframes to clear plasma read-only error
* Make some notes, WIP
* Cleaned up code a bit, still need more error checking
* Adding error checking and addressing comments
* Addressing comment
* Adding test
* Addressing rebase artifact
* Fixing indexing bug
* Some minor cleanup
* implemented sample - need to test
* sample fully working
* added sanity check tests
* added some comments to clarify the _deploy_func call
* some more clarifying comments
* added explanatory comments
* minor change in weights_sum for sample
* eval now works without assignment - helper function a bit hacky
* removed df.copy() from eval_helper
* one test still failing for qury
* all eval tests passing now
* added check to eval arge verification
* added tests to travis
* added optimization and some comments
* added pd.eval and passes all tests
* added ray dataframe back to test file
* optimizations and code cleanup for eval
* changed position of pandas import in __init__
* fixed linting errors
* fixing eval in __init__.py
* fixed travis file - removed extra tests
* removed test directory from linting exclude for travis
* working with dataframes with too many rows and columns
* repr works for jupyter notebooks now
* added comments and test file
* added repr test file to .travis.yml
* added back ray.dataframe as pd to test file
* fixed pandas importing issues in test file
* getting the front and back of df more efficiently
* only keeping dataframe tests in travis
* fixing numpy array for row and col lengths issue
* doesn't add dimensions if df is small enough
* implemented memory_usage()
* completed memory_usage - still failing 2 tests
* only failing one test for memory_usage
* all repr and dataframes tests passing now
* fixing error related to python2 in info()
* fixing python2 errors
* fixed linting errosr
* using _arithmetic_helper in memory_usage()
* fixed last lint error
* removed testing-specific code
* adding back travis test
* removing extra tests from travis
* re-added concat test
* fixes with new indexing scheme
* code cleanup
* fully working with new indexing scheme
* added tests for info and memory_usage
* removed test file
* baseline impl for index_df.py
* added skeleton for index_df.py
* initial impl index_df
* separate out partition and non-partition impls
* add len function
* drop returns index_df slice of dropped indices
* housecleaning
* Integrate index overhaul
* Rename index df to index metadata
* Fix flake8 issues
* Addressing issues
* fix import issue
* Added metadata passing to constructor
adding tests
fixing flake8
adding init
flake 8 on test
fixing tests, imports, and flake8
handling for index
adding tests for row, index
added more robust error handling for axis
fixing test failures
cleaning up error sfor 2.7
updating travis
resolving import
fixing flake8
moved import order
Fixing to refactor and delaying implementing ray-pd inner concat
resolving ray-pd concat and from_pandas mutation
Revert "resolving ray-pd concat and from_pandas mutation"
This reverts commit 5db43e4e89e328286532f3ef98a4526575c5d08d.
* Index update
* Fixed transpose bug with nan values
* Fix lint
* Add rename tests
* Implement DataFrame.rename, DataFrame.rename_axis, and Index.set_names
* Temp
* Fixing rename for new index implementation
Fix rebase merges
* Fix rename and rename_axis to work with new index.
Re-add pytest fixture
Clean up rebase artifacts
Remove index.py file
* Addressing minor points
* Addressing comments
* Implement ray.DataFrame.drop w/ tests
* Implement ray.DataFrame.eval w/ tests
Fix flake8 issues
* Fix flake8 issues in dataframe.py
* Implement fillna
* Implement fillna
* Implement ffill and bfill
* Define helper functions outside of method invocation
* Implement ray.DataFrame.eval w/ tests
* Index update
* Fixed transpose bug with nan values
* Fix lint
* Implement fillna
* Use ray index to check if labels exist in df
* Fix ValueError catching
* Remove duplicate test methods
* Add documentation for .fillna(), .ffill(), .bfill(), .eval(), and .drop()
Fix flake8 errors
* Remove notebook files
* Change fillna, eval, drop to use new index type
* Fix documentation for fillna, eval and drop
temp
Temp
temp
temp
temp
* Update drop to work with new type of ray index
* Fix flake8 errors
* Refactor fillna fix for index
* Add parquet-cpp to gitignore
* Add read_csv and read_parquet
* Gitignore pytest_cache
* Fix flake8
* Add io to __init__
* Changing Index. Currently running tests, but so far untested.
* Removing issue of reassigning DF in from_pandas
* Fixing lint
* Fix bug
* Fix bug
* Fix bug
* Better performance
* Fixing index issue with sum
* Address comments
* Update io with index
* Updating performance and implementation. Adding tests
* Fixing off-by-1
* Fix lint
* Address Comments
* Make pop compatible with new to_pandas
* Format Code
* Cleanup some index issue
* Bug fix: assigned reset_index back
* Implement loc and iloc
* Revert whitespace
* Format code
* Address comments
* Add parquet-cpp to gitignore
* Add read_csv and read_parquet
* Gitignore pytest_cache
* Fix flake8
* Add io to __init__
* Changing Index. Currently running tests, but so far untested.
* Removing issue of reassigning DF in from_pandas
* Fixing lint
* Fix bug
* Fix bug
* Fix bug
* Better performance
* Fixing index issue with sum
* Address comments
* Update io with index
* Updating performance and implementation. Adding tests
* Fixing off-by-1
* Fix lint
* Address Comments
* Make pop compatible with new to_pandas
* Format Code
* Cleanup some index issue
* Bug fix: assigned reset_index back
* Remove unused debug line
Hari Subbaraj