From 4c61d1f30a29db8404606c6c933a5a2f3c0ae1ae Mon Sep 17 00:00:00 2001 From: William Falcon Date: Mon, 16 Sep 2019 11:07:16 -0400 Subject: [PATCH] updated docs --- docs/Trainer/SLURM Managed Cluster.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/docs/Trainer/SLURM Managed Cluster.md b/docs/Trainer/SLURM Managed Cluster.md index eaa3c81b..c2049408 100644 --- a/docs/Trainer/SLURM Managed Cluster.md +++ b/docs/Trainer/SLURM Managed Cluster.md @@ -86,6 +86,11 @@ cluster.optimize_parallel_cluster_gpu( job_display_name='my_exp') ``` +**NOTE** nb_trials specifies how many of the possible permutations to use. If using ```grid_search``` it will use +the depth first ordering. If using ```random_search``` it will use the first k shuffled options. FYI, random search +has been shown to be just as good as any Bayesian optimization method when using a reasonable number of samples (60), +[see this paper for more information](http://www.jmlr.org/papers/volume13/bergstra12a/bergstra12a.pdf). + --- #### Walltime auto-resubmit Lightning automatically resubmits jobs when they reach the walltime. Make sure to set the SIGUSR1 signal in