wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-07-06 05:16:30 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,637 Commits 36 Branches 42 Tags
a082ea18b8bcc127f348147cb9997b91b32fcced
Commit Graph

6637 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Sven Mika a082ea18b8 [RLlib] Issue 12212: "TFEagerPolicy has no attribute action_sampler_fn. 2020-12-11 12:57:33 +01:00
Stephanie Wang 86b0741026 [new scheduler] Allocate resources for spilled back task to a local view of the remote node (#12711) 
* Force report heartbeats if remote resources may be dirty

* lint

* typo

* typo

* unit test

* debug

* Revert "lint"

This reverts commit 6dc7e982ffee98185665eb7c3c8fde0d91938919.

* Revert "Force report heartbeats if remote resources may be dirty"

This reverts commit cbfa9405197df62f874107d55b46715ceae2abd2.

* Local view of resources

* debug travis

* debug

* debug

* debug

* weaken test

* cleanups

* lint

* Revert "debug travis"

This reverts commit 11ff5f4f84e64e9fbd4eecda5b3c7fd07a7130a4.

* revert

* const view, remove unused
 2020-12-10 22:43:29 -05:00
Barak Michener b7f246c451 [ray_client] Include multiple facets of the Ray API (#12736) 2020-12-10 19:09:34 -08:00
Sumanth Ratna 8d1ad25545 [docs] Add troubleshooting section to installation page (#12659) 
* Add troubleshooting section to installation docs

* Set fix instructions lang to bash

* Update doc/source/installation.rst

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
 2020-12-10 18:56:56 -08:00
Ian Rodney 9b3ef2f340 [docs] Fix Docker links (#12702) 
* switch autoscaler -> ray-ml

* add more tables
 2020-12-10 18:08:48 -08:00
Edward Oakes 62d6b0a558 Fix max_task_retries for named actors (#12762) 2020-12-10 18:24:55 -06:00
Edward Oakes 0e90cbcd19 Remove unused ci/performance_tests (#12767) 2020-12-10 18:23:16 -06:00
Edward Oakes c7b6ec88ef [serve] Make serve __del__ log DEBUG level (#12766) 2020-12-10 18:14:55 -06:00
Edward Oakes 3c44c0d3e4 [serve] Long polling for routes in http server (#12724) 2020-12-10 18:02:02 -06:00
Lee moon soo 006856b9a1 fix gpu base image name in build-docker.sh script (#12642) 2020-12-10 14:31:59 -08:00
Sumanth Ratna 932837eb4c [streaming] Remove unused imports in streaming CI tests (#12722) 2020-12-10 16:27:06 -06:00
Ruoyun Huang 2e084959a1 Fix a wrong import in test_performance.py (#12734) 2020-12-10 16:26:21 -06:00
Eric Squires 231ecffa3d add tags.lock and tags.temp to .gitignore (#12752) 
These can be temporarily created by vim.
 2020-12-10 14:24:32 -08:00
Eric Squires 9f70293700 Remove debug extras from setup.py (#12751) 2020-12-10 16:23:11 -06:00
architkulkarni 3fd3cb96ed [Utils] Add Queue async and batch methods (#12578) 2020-12-10 10:49:18 -06:00
Ian Rodney 38ba238606 [serve] Create FutureResults from ControllerAPI (#12577) 2020-12-10 10:44:08 -06:00
Sven Mika deb33bce84 [RLlib] Add DQN SoftQ learning test case. (#12712) 2020-12-10 14:55:19 +01:00
Kai Yang e3b5deb741 [Multi-tenancy] Delete flag enable_multi_tenancy and remove old code path (#10573) 2020-12-10 19:01:40 +08:00
Robert Nishihara d681991773 Add Discourse to readme and make it more prominent in docs. (#12740) 2020-12-10 01:13:40 -08:00
Ian Rodney cf30630d2e [docker] Use legacy resolver (#12741) 2020-12-10 01:12:46 -08:00
Ameer Haj Ali 2f8e308444 [autoscaler] LoadMetrics missed logger.debug (#12714) 2020-12-09 17:19:36 -08:00
Ian Rodney a9da4f3201 [docker] Make Ray-ml more compatible (#12574) 2020-12-09 16:03:39 -08:00
Stephanie Wang a776209aec Revert "Fix dashboard agent check ppid is raylet pid (#12256)" (#12729) 
This reverts commit 3ce9286977.
 2020-12-09 17:20:38 -05:00
dHannasch d455cae036 Add period to error message. (#12716) 2020-12-09 15:58:21 -06:00
Richard Liaw 974570b4fb oops (#12728) 
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
 2020-12-09 13:38:10 -08:00
Keqiu Hu ee012532fb [core] Use node manager client pool for GCS service #10398 (#12368) 
* raylet client pool

* Fix merging conflict

* Fix documentation typo

* fix linting

* address comments

* fix typo

* remove unintended logging

* address comments

* fix bazel file lint error
 2020-12-09 12:44:40 -08:00
architkulkarni 8b9197ea8c [Doc] replace github discussion link with discourse (#12684) 2020-12-09 12:43:45 -08:00
Edward Oakes c9873cdbc3 [Serve] Remove unused assign_request wrapper (#12721) 2020-12-09 12:22:43 -08:00
Alex Wu 0b6e44efb8 [New scheduler] Cluster Resource Scheduler dynamic resources (for placement groups) (#12518) 
* prepare implemented

* dynamic resources

* .

* commit

* .

* .

* Still needs to be cleaned up

* Passes basic tests + cleanup

* .

* .

* .

* Apply suggestions from code review

Co-authored-by: SangBin Cho <rkooo567@gmail.com>

* fix

* lint

Co-authored-by: Alex <alex@anyscale.com>
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
 2020-12-09 12:05:31 -08:00
fangfengbin ef9ebbc636 [GCS]GCS based Actor Scheduling support actor colocation (#12707) 
* [GCS]GCS based Actor Scheduling support actor colocation

* fix review comment

Co-authored-by: 灵洵 <fengbin.ffb@antgroup.com>
 2020-12-09 11:54:23 -08:00
Sven Mika ea25482f6a WIP. (#12706) 2020-12-09 11:49:21 -08:00
Ian Rodney 19542c5eb0 [docker] Default to ray-ml image (#12703) 2020-12-09 11:49:16 -08:00
architkulkarni 6f3aacd087 [serve] Clarify conda env docs (#12679) 2020-12-09 13:35:48 -06:00
Sven Mika f6241302a8 [RLlib] Fix issue 12678: MultiAgentBatch has no attribute total. (#12704) 2020-12-09 16:41:13 +01:00
fyrestone 3ce9286977 Fix dashboard agent check ppid is raylet pid (#12256) 
* Dashboard agent check ppid is raylet pid

* Improve implementation

* Refine code

* Make the RAY_NODE_PID environment required for dashboard agent

Co-authored-by: 刘宝 <po.lb@antfin.com>
 2020-12-09 09:12:34 -05:00
Stephanie Wang 840de49161 Fix race condition between failure detection and references going out of scope (#12573) 
* fix

* lint

* fix initialization
 2020-12-08 23:49:55 -08:00
Sven Mika 28108c905b [RLlib] Tf-eager policy bug fix: Duplicate model call in compute_gradients. (#12682) 2020-12-09 08:03:58 +01:00
Eric Liang cab46b7931 Improve issue templates (#12687) 
* update

* Update .github/ISSUE_TEMPLATE/bug_report.md

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
 2020-12-08 22:29:03 -08:00
Alex Wu bd7e26b768 [Autoscaler] Temporarily suppress "Removed stale ip mappings" message. (#12689) 2020-12-08 21:55:10 -08:00
Barak Michener dc4b5c7aa3 [ray_client] Passing actors to actors (#12585) 
* start building tests around passing handles to handles

Change-Id: Ie8c3de5c8ce789c3ec8d29f0702df80ba598279f

* clean up the switch statements by moving to a method, implement state tranfer, extend test

Change-Id: Ie7b6493db3a6c203d3a0b262b8fbacb90e5cdbc5

* passing

Change-Id: Id88dc0a41da1c9d5ba68f754c5b57141aae47beb

* flush out tests

Change-Id: If77c0f586e9e99449d494be4e85f854e4a7a4952

* formatting

Change-Id: I497c07cee70b52453b221ed4393f04f6f560061e

* fix python3.6 and other attributes

Change-Id: I5a2c5231e8a021184d9dfc3e346df7f71fc93257

* address documentation

Change-Id: I049d841ed1f85b7350c17c05da4a4d81d5cb03df

* formatting

Change-Id: I6a2b32a2466ffc9f03fc91ac17901b9c1a49505c

* use the pickled handle as the id bytes for actors

Change-Id: I9ddcb41d614de65d42d6f0382fe0faa7ad2c2ade

* pydoc

Change-Id: I9b32a0f383d5ff5ac052e61929b7ae3e42a89fc5

* format

Change-Id: Iac0010bb990a4025a98139ab88700030b2e9e7f5

* todos

Change-Id: I7b550800cf7499403e8a17b77484bc46f20f0afc

* tests

Change-Id: If8ebf6a335baeb113c1332acc930c41a6b4f5384

* fix lint

Change-Id: I019f41e0ec341d39bbbbd39aa43d9fb5f8b57cf0

* nits

Change-Id: I2e6813d8db34f4ce008326faa095d414c10eee95

* add some tricky, python3.6-troublesome type checking

Change-Id: Ib887fc943a6e7084002bc13dfbe113b69b4d9317
 2020-12-08 21:54:55 -08:00
Richard Liaw d534719af6 temporary-fix (#12700) 
Signed-off-by: Richard Liaw <rliaw@berkeley.edu>
 2020-12-08 21:48:26 -08:00
Ameer Haj Ali a4dbb271bd [hotfix][autoscaler] Request resources refactor2 (#12661) 
* prepare for head node

* move command runner interface outside _private

* remove space

* Eric

* flake

* min_workers in multi node type

* fixing edge cases

* eric not idle

* fix target_workers to consider min_workers of node types

* idle timeout

* minor

* minor fix

* test

* lint

* eric v2

* eric 3

* min_workers constraint before bin packing

* Update resource_demand_scheduler.py

* Revert "Update resource_demand_scheduler.py"

This reverts commit 818a63a2c86d8437b3ef21c5035d701c1d1127b5.

* reducing diff

* make get_nodes_to_launch return a dict

* merge

* weird merge fix

* auto fill instance types for AWS

* Alex/Eric

* Update doc/source/cluster/autoscaling.rst

* merge autofill and input from user

* logger.exception

* make the yaml use the default autofill

* docs Eric

* remove test_autoscaler_yaml from windows tests

* lets try changing the test a bit

* return test

* lets see

* edward

* Limit max launch concurrency

* commenting frac TODO

* move to resource demand scheduler

* use STATUS UP TO DATE

* Eric

* make logger of gc freed refs debug instead of info

* add cluster name to docker mount prefix directory

* grrR

* fix tests

* moving docker directory to sdk

* move the import to prevent circular dependency

* smallf fix

* ian

* fix max launch concurrency bug to assume failing nodes as pending and consider only load_metric's connected nodes as running

* small fix

* request_resources -> min workers

* test fixes

* add race condition tests

* Eric

* fixes

* semi final

* semi final

* lint

* lint

Co-authored-by: Ameer Haj Ali <ameerhajali@ameers-mbp.lan>
Co-authored-by: Alex Wu <alex@anyscale.io>
Co-authored-by: Alex Wu <itswu.alex@gmail.com>
Co-authored-by: Eric Liang <ekhliang@gmail.com>
Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local>
 2020-12-08 18:41:30 -08:00
Philipp Moritz 343b479ae2 [TEST] Fix Ray windows build for debugger (#12671) 
* Fix Ray windows build for debugger

* update
 2020-12-08 18:12:48 -08:00
Sven Mika e40b14d255 [RLlib] Batch-size for truncate_episode batch_mode should be confgurable in agent-steps (rather than env-steps), if needed. (#12420) 2020-12-08 16:41:45 -08:00
Edward Oakes fd4e025da6 [serve] Add docs on configuring cv2 parallelism (#12652) 2020-12-08 16:03:13 -06:00
Stephanie Wang 50f28811ac [new scheduler] Always spill back to a feasible node if the local node is not feasible (#12557) 
* fix

lint

* feasible nodes

* Enable test, cleanup

* Revert "fix"

This reverts commit aef81d04c0b4560b758f846e1afdafbdb5552efe.

* unit test

* doc
 2020-12-08 13:46:58 -05:00
Sumanth Ratna b7404e7955 [dashboard] Resolve npm vulnerabilities (#12620) 
* npm audit fix

* npm dedupe
 2020-12-08 10:26:49 -08:00
Kai Fricke df10b84113 [Release] release tests yamls for Tune & GPU (#12496) 2020-12-08 10:15:07 -08:00
Gekho457 f61bc79a87 Dmitri/k8s command runner home try again (#12609) 2020-12-08 11:44:22 -06:00
Keqiu Hu 2a9079aef9 [grpc]'ray memory' fails if there are many objects in scope #8502 (#12673) 2020-12-08 09:36:53 -08:00