Commit Graph
17 Commits
Author SHA1 Message Date
Johann Schleier-Smith 29c8471fd4 Add multinode tests by simulating multiple nodes using Docker. (#378)
* run test workloads for a Docker cluster

* better manage docker image versions

* Changes to make multinode docker tests work with Python 3.

* option to mount local test directory on head node to speed development

* Attempt to simplify multinode test setup.

* Small change.

* Add in development-mode to run multinode docker tests more easily during development.

* add jenkins test script that links to Docker hash

* Read docker SHA from build_docker.sh and add test that should fail.

* Consolidate implementations and remove duplicate files.

* Allow test to retry if it fails to schedule on all nodes.

* Remove sleep when in docker multinode tests.
2017-03-18 23:44:54 -07:00
Johann Schleier-Smith ad4b03bf7f Docker Updates (#308)
* new path for python build

* add flag

* build tar using git archive

* no exit from start_ray.sh

* update Docker instructions

* update build docker script

* add git revision

* fix typo

* bug fixes and clarifications

* mend

* add objectmanager ports to docker instructions

* rewording

* Small updates to documentation.
2017-02-28 18:57:51 -08:00
Johann Schleier-Smith c9bc488ee0 Redirect process output to log files (#267)
* redirect process output to log files

* formatting fixes

* Generate all log files in start_ray_processes.

* Fix bug.
2017-02-16 20:34:45 -08:00
Johann Schleier-Smith 7bf80b6b22 bug fix on printing exception traceback (#268) 2017-02-10 21:05:05 -08:00
Johann Schleier-Smith 883bedf46e Add documentation for upgrading a Ray cluster. (#256)
* add documentation for upgrading a Ray cluster

* Update documentation and link to it from README.
2017-02-09 11:55:37 -08:00
Johann Schleier-Smith e5a9fc0032 Cluster setup instructions (#233)
* start updating cluster documentation with parallel ssh

* add using ray on a large cluster

* revert changes to using ray on a cluster

* update cluster documentation

* update title

* Some formatting changes, and added some notes.

* clarification

* Add warning about public versus private IP addresses.

* Typos and wording.

* Clarifications.

* Clarifications.
2017-02-02 16:10:26 -08:00
Johann Schleier-Smith 6ad2b5d87a Add Redis port option to startup script (#232)
* specify redis address when starting head

* cleanup

* update starting cluster documentation

* Whitespace.

* Address Philipp's comments.

* Change redis_host -> redis_ip_address.
2017-01-31 00:28:00 -08:00
Johann Schleier-Smith 4f6100b67f fix docker build bug (#207) 2017-01-18 23:23:34 -08:00
Johann Schleier-Smith b1e76e582e Check /dev/shm on Linux (#174)
* check available shared memory when starting object store

* exit with error if not enough shared memory available for object store

* Some comments and formatting.
2017-01-03 12:33:29 -08:00
Johann Schleier-Smith 8bb87a4f6b updated Docker files (#171)
* updated Docker files

* single Docker RUN for apt-get installs and cleanup

* stylistic cleanup
2016-12-31 17:21:33 -08:00
Johann Schleier-Smith 1616426ccf add wget dependency for osx install (#172) 2016-12-31 16:06:00 -08:00
Johann Schleier-Smith d8dd9de81b remove verbose flag in tar (#363) 2016-08-09 13:43:25 -07:00
Johann Schleier-Smith 149c13913a ignoring build output and example datasets (#360) 2016-08-09 11:30:33 -07:00
Johann Schleier-Smith 4d5f85e77c Fix Travis failure detection on Mac + testing enhancements (#358)
* properly handle failure in continuous integration

* add stack overflow reference
2016-08-08 18:02:52 -07:00
Johann Schleier-Smith 3ee0fd8f34 Update cluster guide (#347)
* clarify cluster setup instructions

* update multinode documentation, update cluster script, fix minor bug in worker.py

* clarify cluster documentation and fix update_user_code
2016-08-04 09:14:20 -07:00
Johann Schleier-Smith 583df08957 Docker builds on Travis (#343)
* attempt to build on travis using docker

* run tests in foreground

* add examples to travis tests

* test from current checkout

* attempt to fix docker version issues

* try build with xenial

* attempt docker upgrade

* avoid hang on configuration files

* matrix osx and linux w/ docker

* restore non-test docker builds

* fix typo

* tuning and cleanup

* add missing file

* comment cleanup
2016-08-02 17:03:28 -07:00
Johann Schleier-Smith 79e4a5a00e Ray with Docker (#324)
* Ray with Docker

* cleanup based on comments

* rename docker user to ray-user

* add examples docker image

* working toward reliable Docker devel image

* adjust ray-user uid for Linux builds on AWS

* update documentation

* reduced dependencies for examples

* updated Docker documentation

* experimental notice on developing with Docker
2016-08-01 16:44:11 -07:00