wassname/ray
1
0
Fork 0
mirror of https://github.com/wassname/ray.git synced 2026-06-28 10:33:16 +08:00
Code Issues Packages Projects Releases Wiki Activity

[Object Spilling] Multi node file spilling V2. (#13542)

Browse Source 
* done.

* done.

* Fix a mistake.

* Ready.

* Fix issues.

* fix.

* Finished the first round of code review.

* formatting.

* In progress.

* Formatting.

* Addressed code review.

* Formatting

* Fix tests.

* fix bugs.

* Skip flaky tests for now.
This commit is contained in:
SangBin Cho
2021-01-23 23:15:32 -08:00
committed by GitHub
parent e675e5b75a
commit edbb2937d3
36 changed files with 573 additions and 249 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/ray/parameter.py
+3
View File
@@ -330,3 +330,6 @@ class RayParams:
# Validate external storage usage.
external_storage.setup_external_storage(object_spilling_config)
external_storage.reset_external_storage()
# Configure the proper system config.
self._system_config["is_external_storage_type_fs"] = (
object_spilling_config["type"] == "filesystem")