[tune] add scalability release tests (#13986)

* Add scalability tests

* Network overhead cluster

* Update xgboost tests

* Document release tests

* Don't raise on failed trial

* Update to multi node yamls

* Update yamls

* Revert xgboost test changes

* Fix import

* Update release/tune_tests/scalability_tests/workloads/test_bookkeeping_overhead.py

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>

* Pass aws credentials (WIP)

* Update durable trainable example

* Update xgboost sweep

* Change xgboost scope, fix durable trainable stop condition

* Fix max depth to limit total test length

* Add cluster information to test descriptions. Update release checklist/process docs

Co-authored-by: Richard Liaw <rliaw@berkeley.edu>
This commit is contained in:
Kai Fricke
2021-02-10 17:16:31 +01:00
committed by GitHub
co-authored by Richard Liaw
parent 81e7434091
commit 1ef2a6790c
21 changed files with 896 additions and 100 deletions
+8 -2
View File
@@ -62,8 +62,14 @@ This checklist is meant to be used in conjunction with the RELEASE_PROCESS.rst d
- [ ] K8s operator test
- [ ] Data processing tests
- [ ] streaming_shuffle
- [x] Tune tests
- [x] ignore for now
- [ ] Tune tests
- [ ] test_bookkeeping_overhead
- [x] test_result_throughput_cluster (ignore final time)
- [x] test_result_throughput_single_node (ignore final time)
- [x] test_network_overhead (ignore final time)
- [ ] test_long_running_large_checkpoints
- [ ] test_xgboost_sweep
- [ ] test_durable_trainable
- [ ] XGBoost Tests
- [ ] distributed_api_test
- [ ] train_small