Daniel Edgecumbe 315edab085 [autoscaler] Speedups (#3720) ...

- NodeUpdater gets its' IP in parallel now (no longer in __init__)
- We use persistent connections in SSH (temp folder created only for ray; ControlMaster)
- hash_runtime_conf was performing a pointless hexlify step, wasting time on large files
- We use NodeUpdaterThreads and share the NodeProvider; NodeUpdaterProcess is removed
- AWSNodeProvider caches nodes more aggressively
- NodeProvider now has a shim batch terminate_nodes() call; AWSNodeProvider parallelises it; the autoscaler uses it
- AWSNodeProvider batches EC2 update_tags calls
- Logging changes throughout to provide standardised timing information for profiling
- Pulled out a few unnecessary is_running calls (NodeUpdater will loop waiting for SSH anyway)

## Related issue number
Issue #3599

2019-02-01 02:46:32 -08:00

..

benchmarks

Change timeout from milliseconds to seconds in ray.wait. (#3706)

2019-01-08 21:32:08 -08:00

ray

[autoscaler] Speedups (#3720)

2019-02-01 02:46:32 -08:00

asv.conf.json

[asv] Pushing to s3 (#2246)

2018-06-20 10:43:44 -07:00

build-wheel-macos.sh

Fix pyarrow version (#3760)

2019-01-13 14:28:23 -08:00

build-wheel-manylinux1.sh

Update arrow to reduce plasma IPCs. (#3497)

2018-12-14 23:49:37 -05:00

CMakeLists.txt

Migrate Python C extension to Cython (#3541)

2019-01-24 09:17:14 -08:00

README-benchmarks.rst

[rllib][asv] Support ASV for RLlib (#2304)

2018-06-28 17:20:09 -07:00

README-building-wheels.md

[DataFrame] Add Parquet Support in Build Process (#1531)

2018-02-16 07:18:42 -08:00

setup.py

Migrate Python C extension to Cython (#3541)

2019-01-24 09:17:14 -08:00