Add external module as a node scaler. (#1703)

* WIP: add external module as a node scaler.

* Fix style.

* Add tests, fix style issues.

* Fix typos.

* Fix test error.

* Fix node provider path.

* Add function to spli pkg from class.

* Add doc.

* Correct documentation.

* Debugging....

* Debugging....

* Add __init__.py to tests.

* add more output for debugging

* Add more test, fix error with import.

* Add a small detail to the documentation.

* Update autoscaler.py
This commit is contained in:
Christian Barra
2018-03-17 16:59:13 -07:00
committed by Eric Liang
parent e3685fca5e
commit 070e27ea7a
5 changed files with 77 additions and 2 deletions
+15
View File
@@ -157,6 +157,21 @@ with GPU worker nodes instead.
MarketType: spot
InstanceType: p2.xlarge
External Node Provider
--------------------------
Ray also supports external node providers (check `node_provider.py <https://github.com/ray-project/ray/tree/master/python/ray/autoscaler/node_provider.py>`__ implementation).
You can specify the external node provider using the yaml config:
.. code-block:: yaml
provider:
type: external
module: mypackage.myclass
The module needs to be in the format `package.provider_class` or `package.sub_package.provider_class`.
Additional Cloud providers
--------------------------