* Add flake8 to Travis
* Add flake8-comprehensions
[flake8 plugin](https://github.com/adamchainz/flake8-comprehensions) that
checks for useless constructions.
* Use generators instead of lists where appropriate
A lot of the builtins can take in generators instead of lists.
This commit applies `flake8-comprehensions` to find them.
* Fix lint error
* Fix some string formatting
The rest can be fixed in another PR
* Fix compound literals syntax
This should probably be merged after #1963.
* dict() -> {}
* Use dict literal syntax
dict(...) -> {...}
* Rewrite nested dicts
* Fix hanging indent
* Add missing import
* Add missing quote
* fmt
* Add missing whitespace
* rm duplicate pip install
This is already installed in another file.
* Fix indent
* move `merge_dicts` into utils
* Bring up to date with `master`
* Add automatic syntax upgrade
* rm pyupgrade
In case users want to still use it on their own, the upgrade-syn.sh script was
left in the `.travis` dir.
* added reindex, __setitem__, select_dtypes, and astype functionality
* readded tests for astype and select_dtypes
* fixed index issue with reindex
* lint spacing
* removing current reindex implementation for future pr
* wrong testing func
* errors now raised in the workers, but suppressing them can be an issue
* updated code for select_dtypes
* Update test_dataframe.py
* Add empty df test
* Fix flake8 issues
* rebase with master
* reset master tests
* Implement df.pipe
* fix tests
* Use test_pipe as a pytest.fixture
* Add newline at EOF
* working for non-string functions and not lists of functions
* works with functions as strings now as well
* fixed linting errors
* throwing a warning if the input is a dictionary
* added dict of lists functionality
* fix minor indexing errors and lint
* removed some commented out code
* some comments and thoughts for apply
* cleaned up code a little bit and added todos
* improved performance
* error checking and code cleanup and comments
* small change
* improved list performance a lot
* agg calls apply for lists
* addressing comments on the PR
* col_metadata change
* updated tests to expect TypeError where appropriate
* Use set/dict literal syntax
Ran code through [pyupgrade](https://github.com/asottile/pyupgrade). This is
supported in every Python version 2.7+.
* Drop unnecessary string format specification
No need to specify 0,1.. if paramters are passed in order.
* Revert "Drop unnecessary string format specification"
This reverts commit efa5ec85d30ff69f34e5ed93e31343fea7647bcb.
* Undo changes to cloudpickle
Drop use of set literal until cloudpickle uses it.
* Reformat code with YAPF
We need to set up a git pre-push hook to automatically run this stuff.
* Begin merge implementation
* Some cleanup
* Continue cleanup
* Allowing merge on index
* Copy dataframes to clear plasma read-only error
* Make some notes, WIP
* Cleaned up code a bit, still need more error checking
* Adding error checking and addressing comments
* Addressing comment
* Adding test
* Addressing rebase artifact
* Fixing indexing bug
* Some minor cleanup
* implemented sample - need to test
* sample fully working
* added sanity check tests
* added some comments to clarify the _deploy_func call
* some more clarifying comments
* added explanatory comments
* minor change in weights_sum for sample
* eval now works without assignment - helper function a bit hacky
* removed df.copy() from eval_helper
* one test still failing for qury
* all eval tests passing now
* added check to eval arge verification
* added tests to travis
* added optimization and some comments
* added pd.eval and passes all tests
* added ray dataframe back to test file
* optimizations and code cleanup for eval
* changed position of pandas import in __init__
* fixed linting errors
* fixing eval in __init__.py
* fixed travis file - removed extra tests
* removed test directory from linting exclude for travis
* working with dataframes with too many rows and columns
* repr works for jupyter notebooks now
* added comments and test file
* added repr test file to .travis.yml
* added back ray.dataframe as pd to test file
* fixed pandas importing issues in test file
* getting the front and back of df more efficiently
* only keeping dataframe tests in travis
* fixing numpy array for row and col lengths issue
* doesn't add dimensions if df is small enough
* implemented memory_usage()
* completed memory_usage - still failing 2 tests
* only failing one test for memory_usage
* all repr and dataframes tests passing now
* fixing error related to python2 in info()
* fixing python2 errors
* fixed linting errosr
* using _arithmetic_helper in memory_usage()
* fixed last lint error
* removed testing-specific code
* adding back travis test
* removing extra tests from travis
* re-added concat test
* fixes with new indexing scheme
* code cleanup
* fully working with new indexing scheme
* added tests for info and memory_usage
* removed test file
* baseline impl for index_df.py
* added skeleton for index_df.py
* initial impl index_df
* separate out partition and non-partition impls
* add len function
* drop returns index_df slice of dropped indices
* housecleaning
* Integrate index overhaul
* Rename index df to index metadata
* Fix flake8 issues
* Addressing issues
* fix import issue
* Added metadata passing to constructor
Peter Schafhalter