dcef909312
Fix for RLIMIT patch ( #12882 )
...
Implement new soft limit introduced by https://github.com/ray-project/ray/pull/12853 .
2020-12-20 16:58:47 -08:00
c21d3feccf
Clip RLIMIT_NOFILE increase to avoid redis failing to start on Big Sur
2020-12-20 16:58:10 -08:00
ffd7d121ad
[Logging] Use file handle temporalily ( #12839 )
2020-12-20 16:43:11 -08:00
c7239d7b73
[hotfix][autoscaler] Request resources refactor2 ( #12661 )
...
* prepare for head node
* move command runner interface outside _private
* remove space
* Eric
* flake
* min_workers in multi node type
* fixing edge cases
* eric not idle
* fix target_workers to consider min_workers of node types
* idle timeout
* minor
* minor fix
* test
* lint
* eric v2
* eric 3
* min_workers constraint before bin packing
* Update resource_demand_scheduler.py
* Revert "Update resource_demand_scheduler.py"
This reverts commit 818a63a2c86d8437b3ef21c5035d701c1d1127b5.
* reducing diff
* make get_nodes_to_launch return a dict
* merge
* weird merge fix
* auto fill instance types for AWS
* Alex/Eric
* Update doc/source/cluster/autoscaling.rst
* merge autofill and input from user
* logger.exception
* make the yaml use the default autofill
* docs Eric
* remove test_autoscaler_yaml from windows tests
* lets try changing the test a bit
* return test
* lets see
* edward
* Limit max launch concurrency
* commenting frac TODO
* move to resource demand scheduler
* use STATUS UP TO DATE
* Eric
* make logger of gc freed refs debug instead of info
* add cluster name to docker mount prefix directory
* grrR
* fix tests
* moving docker directory to sdk
* move the import to prevent circular dependency
* smallf fix
* ian
* fix max launch concurrency bug to assume failing nodes as pending and consider only load_metric's connected nodes as running
* small fix
* request_resources -> min workers
* test fixes
* add race condition tests
* Eric
* fixes
* semi final
* semi final
* lint
* lint
Co-authored-by: Ameer Haj Ali <ameerhajali@ameers-mbp.lan >
Co-authored-by: Alex Wu <alex@anyscale.io >
Co-authored-by: Alex Wu <itswu.alex@gmail.com >
Co-authored-by: Eric Liang <ekhliang@gmail.com >
Co-authored-by: Ameer Haj Ali <ameerhajali@Ameers-MacBook-Pro.local >
2020-12-10 13:50:33 -08:00
ee2cdc0906
oops ( #12728 )
...
Signed-off-by: Richard Liaw <rliaw@berkeley.edu >
2020-12-10 13:48:51 -08:00
ec81eca6b0
[TEST] Fix Ray windows build for debugger ( #12671 )
...
* Fix Ray windows build for debugger
* update
2020-12-10 13:44:12 -08:00
986446d15c
[Release] release tests yamls for Tune & GPU ( #12496 )
2020-12-10 13:36:30 -08:00
162f361dab
[Logging] Fix log monitor issue ( #12588 )
...
* Try fixing issues.
* Verficiation.
2020-12-07 22:01:18 -08:00
b1f2b142d5
[Core] Ensure global state is connected when exception hook is called from the driver. ( #12655 )
2020-12-07 18:28:32 -08:00
401d342602
[PlacementGroup]Add PlacementGroup wait python api ( #12601 )
2020-12-07 13:53:49 +08:00
73a1a232b9
Ray debugger stepping between tasks ( #12075 )
2020-12-06 21:50:18 -08:00
260b07cf0c
[PlacementGroup]Add PlacementGroup wait java api ( #12499 )
...
* add part code
* add part code
* add part code
* add part code
* fix review comments
* fix compile bug
* fix compile bug
* fix review comments
* fix review comments
* fix code style
* add part code
* fix review comments
* fix review comments
* fix code style
* rebase master
* fix bug
* fix lint error
* fix compile bug
* fix newline issue
Co-authored-by: 灵洵 <fengbin.ffb@antgroup.com >
2020-12-05 16:40:04 +08:00
1c0d10f67e
[tune] Add xgboost_ray integration ( #12572 )
2020-12-04 13:59:20 -08:00
219c445648
[tune] verbosity refactor second attempt ( #12571 )
...
Co-authored-by: Richard Liaw <rliaw@berkeley.edu >
2020-12-04 13:56:26 -08:00
7cad648370
[SGD] Fixes TorchTrainer scales up ( #12563 )
2020-12-04 13:55:15 -08:00
f965537ae9
[tune] Callable accepted for register_env ( #12618 )
2020-12-04 12:21:25 -08:00
21fcee28f9
[Java] Simplify Ray.init() by invoking ray start internally ( #10762 )
2020-12-04 14:33:45 +08:00
8cebe1e79c
[autoscaler] Fix worker capping fifo test in new scheduler ( #12512 )
2020-12-03 17:21:35 -08:00
1ce5e0e99f
[tune] Fix file descriptor leak by syncer ( #12590 )
2020-12-03 13:39:04 -08:00
36e46ed923
Revert "[autoscaler/k8s] Use ray node's HOME in Kubernetes command runner. ( #12417 )" ( #12607 )
...
This reverts commit f669830de6
2020-12-03 12:57:59 -08:00
1f7a4806ff
[Serve] Fix Flask Request self reference ( #12560 )
...
* [Serve] Fix Flask Request self reference
* Working flag
* Fix
2020-12-03 10:45:04 -06:00
f669830de6
[autoscaler/k8s] Use ray node's HOME in Kubernetes command runner. ( #12417 )
2020-12-03 10:43:16 -06:00
ff34563539
[PlacementGroup]Fix bug that kill workers mistakenly when gcs restarts ( #12568 )
2020-12-03 17:50:48 +08:00
7c58a85fed
[tune] fix Tensorboard file descriptor leak ( #12425 )
2020-12-03 00:06:54 -08:00
62fbe63f34
Disable flaky test test_delete_objects_multi_node ( #12584 )
...
* update
* fix
* update
2020-12-02 19:19:12 -08:00
8058c1eb54
[serve] Add option to not start HTTP servers ( #11627 )
2020-12-02 16:49:34 -06:00
7422abddb4
[tune] trim kwargs in shim instantiation functions ( #12544 )
2020-12-02 12:07:00 -08:00
da42bf29d0
[tune] horovod release test ( #12495 )
2020-12-02 12:04:54 -08:00
443339ab19
[core] Move out-of-memory handling into the plasma store and support async object creation ( #12186 )
...
* Refactor to extract creation request queue
* timer on oom
* move timer out
* Move evict_if_full and on_store_full into plasma store
* Remove client-side code
* revert
* Distinguish between transient and permanent OOM delays
* update
* Move out create request queue, unit test
* unit test
* Fix max retries
* test
* Do not pin restored objects
* First pass to add polling requests, unit test passes
* worker plasma client retries plasma requests
* cleanup
* Clean up after disconnected clients, check memory leaks
* Support immediate requests in request queue
* Option to try creating immediately
* lint
* Fix build, address comments
* doc
* fixes
* debug travis
* debug
* debug
* debug
* debug
* Revert "debug"
This reverts commit 6bf2f6ee5640e71630c4aecdb7ebf54911ea32db.
Revert "debug"
This reverts commit 73017099c9b06cdaae1217bf0e0f4d23ed68a9e5.
Revert "debug"
This reverts commit 5a155529e28cee9461a598b0cdf7b6a3cc194c93.
Revert "debug"
This reverts commit b50c2101afd45d4cf663daae857bfe1b40387703.
Revert "debug travis"
This reverts commit 012b8721dedf9bca46294ae75eee2815b160368b.
* Skip if new scheduler enabled
* error message
* merge
2020-12-02 13:25:54 -05:00
a21523c709
[tune/core] serialization debugging utility ( #12142 )
...
Co-authored-by: SangBin Cho <rkooo567@gmail.com >
Co-authored-by: Kai Fricke <kai@anyscale.com >
2020-12-02 00:52:17 -08:00
63b85df828
[xgb] update docs ( #12549 )
2020-12-01 23:17:23 -08:00
e428134137
[Hotfix] Pin llvmlite for windows build ( #12559 )
2020-12-01 19:43:08 -08:00
615f974313
Add context for "test_buffer_alignment" ( #12519 )
2020-12-01 19:27:14 -08:00
19c8033df2
[RLlib] Fix most remaining RLlib algos for running with trajectory view API. ( #12366 )
...
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* WIP.
* LINT and fixes.
MB-MPO and MAML not working yet.
* wip
* update
* update
* rmeove
* remove dep
* higher
* Update requirements_rllib.txt
* Update requirements_rllib.txt
* relpos
* no mbmpo
Co-authored-by: Eric Liang <ekhliang@gmail.com >
2020-12-01 17:41:10 -08:00
4dc16730a7
[tune] with-params fix ( #12522 )
2020-12-01 16:47:03 -08:00
7022278ce9
Deflake Serve tests ( #12542 )
2020-12-01 13:42:21 -08:00
6412dfaf38
[ray_client] actors v0 ( #12388 )
2020-12-01 13:12:08 -08:00
0e892908f7
[Object Spilling] Delete spilled objects when references are gone out of scope. ( #12341 )
2020-12-01 13:10:39 -08:00
ef1b0c13c3
Async Future Throws RayError as well ( #12419 )
2020-12-01 13:07:43 -08:00
bdf8ad3b5a
fix ( #12528 )
...
Signed-off-by: Richard Liaw <rliaw@berkeley.edu >
2020-12-01 09:58:12 -08:00
f596113fc7
[Core] Actor Retries Out of Order Tasks on Restart ( #12338 )
2020-12-01 09:35:54 -08:00
f6f3cc9af1
[Core]Remove checkpoint table ( #12235 )
...
* Delete an actor entry from node manager.
* Remove checkpoint table
* remote checkpoint interface
* remove checkpoint interface
* fix ExitActorTest
Co-authored-by: chaokunyang <shawn.ck.yang@gmail.com >
2020-12-01 08:58:36 -08:00
9021f15b2a
[RLlib] Fix setup-dev.py error when creating a softlink for new_dashboard. ( #12442 )
2020-12-01 11:46:59 +01:00
e72147de38
Fix Serve typo ( #12524 )
2020-11-30 23:15:42 -08:00
fd8ae0697b
[autoscaler] Fix test heartbeats single test ( #12513 )
...
* update
* update
* update
2020-11-30 21:24:45 -08:00
f9a99f20dd
Revert "Re-Revert "[Core] zero-copy serializer for pytorch ( #12344 )" ( #12478 )" ( #12515 )
...
This reverts commit 3f22448834
2020-11-30 19:05:55 -08:00
8223a33bff
[Logging] Log rotation on all components ( #12101 )
...
* In Progress.
* Done.
* Fix the issue.
* Add wait for condition because logs are not written right away now.
* debug string.
* lint.
* Fix flaky test.
* Fix issues.
* Fix test.
* lint.
2020-11-30 19:03:55 -08:00
e422ace053
[serve] Create CurrentState & GoalState ( #12369 )
2020-11-30 17:34:30 -08:00
234df9091e
[autoscaler] Try to improve the request_resources() documentation ( #12465 )
2020-11-30 16:03:30 -08:00
9ce7ad17fd
[tune] remove some bottlenecks in trialrunner ( #12476 )
2020-11-30 14:54:25 -08:00
architkulkarni