Commit Graph

2530 Commits

Author SHA1 Message Date
SangBin Cho bfb8a28a3c Revert "Support accessing underlying attributes in RayTaskErrors (#9210)" (#9263)
This reverts commit 21cad5250a.
2020-07-02 08:35:10 -05:00
Sven Mika c4ccbfdfa9 [RLlib] tf-eager support for ES and ARS (tf2.x preparation). (#9207) 2020-07-02 13:03:10 +02:00
fangfengbin 8fcfcc4100 GCS server error handling for actor creation (#8899) 2020-07-02 16:27:32 +08:00
Eric Liang 82a5ed3fb5 [autoscaler] Instance type assert fix for non-AWS node providers (#9223) 2020-07-01 17:54:20 -07:00
Andrija Djurisic e0d8b58969 Fix Azure example-gpu.yml (#9242)
`imageSku` should be string ... otherwise this is the error it shows up:
```
msrestazure.azure_exceptions.CloudError: Azure Error: InvalidTemplate
Message: Deployment template validation failed: 'Template parameter JToken type is not valid. Expected 'String, Uri'. Actual 'Integer'. Please see https://aka.ms/resource-manager-parameter-files for usage details.'.
Additional Information:
	Type: TemplateViolation
	Info: {
	    "lineNumber": 1,
	    "linePosition": 673,
	    "path": "properties.template.parameters.imageSku"
	}

```
2020-07-01 12:02:34 -07:00
Richard Liaw d35f0e40d0 [tune] Use public methods for trainable (#9184) 2020-07-01 11:00:00 -07:00
Edward Oakes 21cad5250a Support accessing underlying attributes in RayTaskErrors (#9210) 2020-07-01 10:49:38 -05:00
Sven Mika b4c0b942fe [RLlib] Remove requirement for dataclasses in rllib (not supported in py3.5) (#9237) 2020-07-01 17:31:44 +02:00
ChenZhilei c11855728a Remove raylet monitor after use GCS service (#9179) 2020-07-01 20:01:52 +08:00
Siyuan (Ryans) Zhuang a1dfcfc893 Add test for Ray outputs (#9231) 2020-06-30 23:54:54 -07:00
Ian Rodney 4ce4be5c54 Show actual command in output (#9224) 2020-06-30 16:00:28 -07:00
Simon Mo be647b69ab [Serve] Performance: Use uvloop when possible (#9216) 2020-06-30 15:59:13 -07:00
Edward Oakes 681bae709a [serve] Add backend config options to docstrings (#9193) 2020-06-30 10:53:17 -05:00
Sven Mika 43043ee4d5 [RLlib] Tf2x preparation; part 2 (upgrading try_import_tf()). (#9136)
* WIP.

* Fixes.

* LINT.

* WIP.

* WIP.

* Fixes.

* Fixes.

* Fixes.

* Fixes.

* WIP.

* Fixes.

* Test

* Fix.

* Fixes and LINT.

* Fixes and LINT.

* LINT.
2020-06-30 10:13:20 +02:00
Ian Rodney fb074da7c3 [core] Return all GPUs for Local Mode (#9108) 2020-06-30 00:55:09 -07:00
mehrdadn 882f60012f Fix WSL patch (it doesn't fall under "win32") (#9195) 2020-06-29 21:00:00 -05:00
krfricke e0b6984dce [tune] pytorch lightning template and walkthrough (#9151)
Co-authored-by: Kai Fricke <kai@anyscale.com>
2020-06-29 16:52:07 -07:00
SangBin Cho 7af6c69672 [Test] Cluster util fix (#8929) 2020-06-29 14:15:41 -05:00
Edward Oakes 87e47c4a53 Fix serve dependencies (#9192) 2020-06-29 12:44:04 -05:00
mehrdadn bc140b69cc Patch WSL psutil bug (#6808) 2020-06-29 10:55:43 -05:00
mehrdadn f4e5561ef7 Fix build error (#9185)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-29 14:51:01 +08:00
mehrdadn 8f72a9fd1a Fix more Windows tests (#9173) 2020-06-28 17:13:15 +08:00
mehrdadn 898e472425 Make test_utils.py use pipes to avoid file access conflicts on Windows (#9072)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-27 22:33:45 +02:00
Richard Liaw 625b66bde7 [docs] Show commands on documentation (#9165) 2020-06-27 12:56:56 -07:00
Sven Mika d6f84bb072 Win10 setup-dev.py fixes. (#9169) 2020-06-27 21:28:11 +02:00
Ian Rodney f940ccd6fb [autoscaler] Better explain min/max/initial worker settings (#9132) 2020-06-25 20:38:03 -07:00
Ian Rodney 42631c5b87 [autoscaler/docker] Migrate --docker to --run-env (#9001) 2020-06-25 20:37:42 -07:00
Stephanie Wang 490cddc250 [core] Refactor distributed ref counting to remove owner task ID (#9049)
* Add intended worker ID to GetObjectStatus, tests

* Remove TaskID owner_id

* lint

* Update message

* lint

* Fix build
2020-06-25 17:55:03 -07:00
krfricke 22ea8dde84 [Tune] Added XGBoost tutorial and template (#9060)
* Added XGBoost tutorial and template

* XGBoost tutorial: Cut some clutter

* Apply suggestions from code review

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Added XGboost logo

* Fixed further references

Co-authored-by: Kai Fricke <kai@anyscale.com>
Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
2020-06-25 15:59:54 -07:00
mehrdadn 07655036d2 [tune] os.replace() instead of os.rename() for cross-platform (#9141)
Co-authored-by: Mehrdad <noreply@github.com>
2020-06-25 12:30:51 -07:00
Xianyang Liu 0bfcc2e5ba [core] Better support multi-nic environments by respecting user-provided IP (#8512) 2020-06-25 14:03:12 -05:00
Alex Wu 46962f5db1 [Core] Log monitor multidriver (#8953) 2020-06-25 11:05:53 -07:00
Eric Liang 4522038259 [iter] Add .transform() function for arbitrary generator transforms (#8978) 2020-06-25 11:04:14 -07:00
henktillman 0f1d99befc [autoscaler] Remove Fingerprint checking (#9133) 2020-06-25 10:22:54 -07:00
Sven Mika 4fd8977eaf [RLlib] Minor cleanup in preparation to tf2.x support. (#9130)
* WIP.

* Fixes.

* LINT.

* Fixes.

* Fixes and LINT.

* WIP.
2020-06-25 19:01:32 +02:00
Edward Oakes aa3fd62cac [serve] Add shadow traffic API (#9106) 2020-06-25 10:55:22 -05:00
Eric Liang 536795ef79 [autoscaler] Initial support for multiple worker types (#9096)
* wip

* fix

* update

* debug state

* fix

* update

* update

* fix test

* fix

* fix

* update

* fix

* types and docs

* update
2020-06-24 23:08:30 -07:00
Eric Liang 0ff24ec8dc Add "ray status" debug tool for autoscaler. (#9091) 2020-06-24 18:22:03 -07:00
Ian Rodney 67e049bc7b [autoscaler/docker] Relax missing docker section (#9105) 2020-06-24 12:35:42 -07:00
Alex Wu c152730e4a [Core] Log output from different jobs to different drivers. (#8885)
* .

* .

* Correct now

* No interactivity errors

* format

* Filtering

* lint

* .

* No more filtering

* Removed interactivity

* .

* .

* .

* .

* .

* .

* Redirection works

* formatting

* something broken?

* .

* Works

* formatting

* redirect output

* formatting

* formatting

* Fix file descriptor leakage

* format

* .

* .

* .

* .

* .

* Refactor

* .

* Only run on job switch

* .

* cleanup

* .

* ...

* Review

* .

* .

* .

* .

* whoops

* .

* Should fix bug

* .

* .

* addressed comments

* formatting

* formatting

* Fix typo

* .

* .

* .

* .

Co-authored-by: Ubuntu <ubuntu@ip-172-31-14-33.us-west-2.compute.internal>
2020-06-23 18:45:32 -07:00
henktillman acb3280235 GCP credentials (#9052) 2020-06-23 17:11:18 -07:00
Max Fitton 7904235517 Node Info Functional Components (#9073) 2020-06-23 13:11:32 -07:00
Edward Oakes c9010eb8ad [serve] Add serve.shutdown() (#8766) 2020-06-23 13:42:03 -05:00
Simon Mo b6d425526d Move actor task submission to io service (#9093) 2020-06-23 10:07:33 -07:00
Xianyang Liu b449ece2ea [SGD] Variable worker CPU requirements (#8963) 2020-06-23 00:43:27 -07:00
Alex Wu 40c15b1ba0 [ParallelIterator] Fix for_each concurrent test cases/bugs (#8964)
* Everything works

* Update python/ray/util/iter.py

Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>

* .

* .

* removed print statements

Co-authored-by: Amog Kamsetty <amogkam@users.noreply.github.com>
2020-06-22 18:26:45 -07:00
Richard Liaw e2330ffc35 [sgd] Cleanup code from last PR (#9076) 2020-06-22 15:17:07 -07:00
Ian Rodney f76552d8db [autoscaler] Expose cache_stopped_nodes in Example YAML (#8981) 2020-06-22 15:02:45 -07:00
Ian Rodney b942bcd798 [Tune] remove whitelist from deep_copy (#8997) 2020-06-22 15:02:27 -07:00
Max Fitton 1d5c123c81 [Hotfix] Fix lint mistake accidentally pushed to master (#9077)
Co-authored-by: Max Fitton <max@semprehealth.com>
2020-06-21 19:19:07 -07:00