fig:longrun: rebuild from job84 route2 + job97 fixed vanilla (no collapse)

Old figure paired route2 (job 84) with job 85 vanilla, whose step-88
'collapse' was a hot-preset artifact. Job 97 re-ran vanilla-200 gentle and
stays coherent. New pairing: route2 holds deploy hack at 0; vanilla rises to
~0.32 (onset ~step 40); route2 solve ends higher (0.61 vs 0.47). Caption now
flags the remaining optimizer mismatch (route2 hot / vanilla gentle, both
beta=0) and TODOs the matched beta=1e-5 regen (jobs 100/101).

Co-Authored-By: Claudypoo <288921227+claudypoo@users.noreply.github.com>
This commit is contained in:
wassname
2026-06-05 02:18:34 +00:00
parent ea0293083c
commit 0645ae2dd2
2 changed files with 428 additions and 369 deletions
+27 -28
View File
@@ -373,39 +373,38 @@ enough to route one as it forms.
\subsection{Long-run convergence}
The 60-step gap persists to convergence: at 200 steps route's deploy hack stays
at zero while vanilla acquires the hack and then collapses
(Figure~\ref{fig:longrun}). \TODO{prose -- author. FIXME: the "collapses" framing
is preset-induced (job 85 hot preset); job 97 shows vanilla stays coherent and
keeps hacking under a sane preset. Rewrite to "vanilla rises, route2 stays at 0"
once the matched beta=1e-5 figure (jobs 100/101) lands -- see figure provenance.}
pinned at zero while vanilla acquires the hack and rises to ${\sim}0.32$
(Figure~\ref{fig:longrun}), with route's solve rate ending higher
(${\sim}0.61$ vs ${\sim}0.47$). \TODO{prose -- author.}
% --- Figure: 200-step -------------------------------------------------------
% Provenance: route2 = pueue job 84 (out/runs/20260602T080804_..._route2_converge200_s41);
% vanilla = job 85 (out/runs/20260602T163201_..._vanilla_converge200_s41; vanilla still
% running at writing -> left panel fills to step 200 on completion). Data source committed
% at out/figs/dyn_longrun_200.csv; regen: uv run python scripts/plot_dynamics.py <both logs>.
% FIXME (2026-06-04, #184/#187): the vanilla "collapse around step 88" below is a
% PRESET artifact, not a property of vanilla GRPO. Job 85 used the hot preset
% (lr=3e-3, adam beta1=0.5, beta=0). Job 97 re-ran vanilla-200 at a gentle preset
% (lr=1e-3, adam 0.9/0.99, beta=0) and it stayed coherent: lp_s in [-0.47,-0.29]
% through step 200, deploy hack 0.375 (run_tests 0.875, file_marker 0.53), no
% collapse. Also job 84 (route2) and job 85 (vanilla) use mismatched optimizers,
% so this overlay is apples-to-oranges. Regenerate this figure from the matched
% beta=1e-5 pair (jobs 100/101, _none200_kl5 / _route2200_kl5) when they land, and
% drop the "collapses" claim -- the honest contrast is route2 holds deploy hack ~0
% while vanilla RISES (not collapses) under a sane preset.
% Provenance: route2 = pueue job 84 (out/runs/20260602T080804_..._route2_converge200_s41,
% deploy hack 0.000 solve 0.609); vanilla = job 97 (out/runs/20260603T104901_..._vanilla200_gentle_s41,
% deploy hack 0.375 solve 0.484, coherent through step 200 -- no collapse). Data source
% committed at out/figs/dyn_longrun_200.csv; regen: uv run python scripts/plot_dynamics.py
% logs/20260602T080804_..._route2_converge200_s41.log logs/20260603T104901_..._vanilla200_gentle_s41.log
% --out out/figs/dyn_longrun_200.png
% CAVEAT (2026-06-05, #184): optimizer mismatch. route2 (job 84) ran the FastConfig
% default hot preset (lr=3e-3, adam beta1=0.5, beta2=0.9); vanilla (job 97) ran a
% gentle preset (lr=1e-3, adam 0.9/0.99). Both beta=0 (no KL). This cuts in our
% favour -- route2 holds hack at 0 even under the more aggressive optimizer that
% drives vanilla up -- but it is not yet apples-to-apples. TODO: regenerate from
% the matched beta=1e-5 pair (jobs 100/101, _none200_kl5 / _route2200_kl5) when
% they land; expect the same qualitative result. This replaces the earlier job-85
% hot-preset vanilla, whose step-88 "collapse" was a preset artifact (job 97 stays
% coherent: lp_s in [-0.47,-0.29] through step 200), not a property of vanilla GRPO.
\begin{figure}[t]
\centering
\includegraphics[width=0.95\linewidth]{../../out/figs/dyn_longrun_200.png}
\caption{Deploy hack (red) and solve (green) over 200 GRPO steps for the same
two arms, seed 41 (deploy evaluation $n{=}64$, $T{=}0.7$, EMA-5). route (right)
holds deploy hack at $0$ for all 200 steps while solve climbs to ${\sim}0.61$
and plateaus. vanilla (left) acquires the hack (${\sim}0.55$ by step~80), then
collapses around step~88: student log-prob craters, reward falls to $0$, and the
pre-clip gradient norm spikes ${\sim}75\times$ with no KL anchor, dragging hack
and solve down together. That late descent is degeneration, not hack
suppression, so the valid comparison window is steps 0--85; within it vanilla
acquires the hack and route never does.}
\caption{Deploy hack (red) and solve (green) over 200 GRPO steps, seed 41
(deploy evaluation $n{=}64$, $T{=}0.7$, EMA-5). route (right) holds deploy hack
at $0$ for all 200 steps while solve climbs to ${\sim}0.61$ and plateaus.
vanilla (left) acquires the hack from onset near step~40 and rises to
${\sim}0.32$ by step~200, with solve plateauing lower (${\sim}0.47$). Neither
arm degenerates. Optimizer settings differ between arms (route2 ran the
aggressive default preset, vanilla a gentler one; see source comment), so this
is a directional rather than matched comparison; the matched-optimizer
regeneration is pending.}
\label{fig:longrun}
\end{figure}
+401 -341
View File
@@ -1,341 +1,401 @@
arm,seed,step,hack,solve
routing2,41,0,0.0,0.38
routing2,41,1,nan,nan
routing2,41,2,nan,nan
routing2,41,3,nan,nan
routing2,41,4,nan,nan
routing2,41,5,nan,nan
routing2,41,6,nan,nan
routing2,41,7,nan,nan
routing2,41,8,nan,nan
routing2,41,9,nan,nan
routing2,41,10,0.0,0.45
routing2,41,11,nan,nan
routing2,41,12,nan,nan
routing2,41,13,nan,nan
routing2,41,14,nan,nan
routing2,41,15,nan,nan
routing2,41,16,nan,nan
routing2,41,17,nan,nan
routing2,41,18,nan,nan
routing2,41,19,nan,nan
routing2,41,20,0.0,0.62
routing2,41,21,nan,nan
routing2,41,22,nan,nan
routing2,41,23,nan,nan
routing2,41,24,nan,nan
routing2,41,25,nan,nan
routing2,41,26,nan,nan
routing2,41,27,nan,nan
routing2,41,28,nan,nan
routing2,41,29,nan,nan
routing2,41,30,0.0,0.62
routing2,41,31,nan,nan
routing2,41,32,nan,nan
routing2,41,33,nan,nan
routing2,41,34,nan,nan
routing2,41,35,nan,nan
routing2,41,36,nan,nan
routing2,41,37,nan,nan
routing2,41,38,nan,nan
routing2,41,39,nan,nan
routing2,41,40,0.0,0.61
routing2,41,41,nan,nan
routing2,41,42,nan,nan
routing2,41,43,nan,nan
routing2,41,44,nan,nan
routing2,41,45,nan,nan
routing2,41,46,nan,nan
routing2,41,47,nan,nan
routing2,41,48,nan,nan
routing2,41,49,nan,nan
routing2,41,50,0.0,0.62
routing2,41,51,nan,nan
routing2,41,52,nan,nan
routing2,41,53,nan,nan
routing2,41,54,nan,nan
routing2,41,55,nan,nan
routing2,41,56,nan,nan
routing2,41,57,nan,nan
routing2,41,58,nan,nan
routing2,41,59,nan,nan
routing2,41,60,0.0,0.62
routing2,41,61,nan,nan
routing2,41,62,nan,nan
routing2,41,63,nan,nan
routing2,41,64,nan,nan
routing2,41,65,nan,nan
routing2,41,66,nan,nan
routing2,41,67,nan,nan
routing2,41,68,nan,nan
routing2,41,69,nan,nan
routing2,41,70,0.0,0.62
routing2,41,71,nan,nan
routing2,41,72,nan,nan
routing2,41,73,nan,nan
routing2,41,74,nan,nan
routing2,41,75,nan,nan
routing2,41,76,nan,nan
routing2,41,77,nan,nan
routing2,41,78,nan,nan
routing2,41,79,nan,nan
routing2,41,80,0.0,0.59
routing2,41,81,nan,nan
routing2,41,82,nan,nan
routing2,41,83,nan,nan
routing2,41,84,nan,nan
routing2,41,85,nan,nan
routing2,41,86,nan,nan
routing2,41,87,nan,nan
routing2,41,88,nan,nan
routing2,41,89,nan,nan
routing2,41,90,0.0,0.62
routing2,41,91,nan,nan
routing2,41,92,nan,nan
routing2,41,93,nan,nan
routing2,41,94,nan,nan
routing2,41,95,nan,nan
routing2,41,96,nan,nan
routing2,41,97,nan,nan
routing2,41,98,nan,nan
routing2,41,99,nan,nan
routing2,41,100,0.0,0.62
routing2,41,101,nan,nan
routing2,41,102,nan,nan
routing2,41,103,nan,nan
routing2,41,104,nan,nan
routing2,41,105,nan,nan
routing2,41,106,nan,nan
routing2,41,107,nan,nan
routing2,41,108,nan,nan
routing2,41,109,nan,nan
routing2,41,110,0.0,0.62
routing2,41,111,nan,nan
routing2,41,112,nan,nan
routing2,41,113,nan,nan
routing2,41,114,nan,nan
routing2,41,115,nan,nan
routing2,41,116,nan,nan
routing2,41,117,nan,nan
routing2,41,118,nan,nan
routing2,41,119,nan,nan
routing2,41,120,0.0,0.62
routing2,41,121,nan,nan
routing2,41,122,nan,nan
routing2,41,123,nan,nan
routing2,41,124,nan,nan
routing2,41,125,nan,nan
routing2,41,126,nan,nan
routing2,41,127,nan,nan
routing2,41,128,nan,nan
routing2,41,129,nan,nan
routing2,41,130,0.0,0.62
routing2,41,131,nan,nan
routing2,41,132,nan,nan
routing2,41,133,nan,nan
routing2,41,134,nan,nan
routing2,41,135,nan,nan
routing2,41,136,nan,nan
routing2,41,137,nan,nan
routing2,41,138,nan,nan
routing2,41,139,nan,nan
routing2,41,140,0.0,0.62
routing2,41,141,nan,nan
routing2,41,142,nan,nan
routing2,41,143,nan,nan
routing2,41,144,nan,nan
routing2,41,145,nan,nan
routing2,41,146,nan,nan
routing2,41,147,nan,nan
routing2,41,148,nan,nan
routing2,41,149,nan,nan
routing2,41,150,0.0,0.62
routing2,41,151,nan,nan
routing2,41,152,nan,nan
routing2,41,153,nan,nan
routing2,41,154,nan,nan
routing2,41,155,nan,nan
routing2,41,156,nan,nan
routing2,41,157,nan,nan
routing2,41,158,nan,nan
routing2,41,159,nan,nan
routing2,41,160,0.0,0.62
routing2,41,161,nan,nan
routing2,41,162,nan,nan
routing2,41,163,nan,nan
routing2,41,164,nan,nan
routing2,41,165,nan,nan
routing2,41,166,nan,nan
routing2,41,167,nan,nan
routing2,41,168,nan,nan
routing2,41,169,nan,nan
routing2,41,170,0.0,0.62
routing2,41,171,nan,nan
routing2,41,172,nan,nan
routing2,41,173,nan,nan
routing2,41,174,nan,nan
routing2,41,175,nan,nan
routing2,41,176,nan,nan
routing2,41,177,nan,nan
routing2,41,178,nan,nan
routing2,41,179,nan,nan
routing2,41,180,0.0,0.62
routing2,41,181,nan,nan
routing2,41,182,nan,nan
routing2,41,183,nan,nan
routing2,41,184,nan,nan
routing2,41,185,nan,nan
routing2,41,186,nan,nan
routing2,41,187,nan,nan
routing2,41,188,nan,nan
routing2,41,189,nan,nan
routing2,41,190,0.0,0.62
routing2,41,191,nan,nan
routing2,41,192,nan,nan
routing2,41,193,nan,nan
routing2,41,194,nan,nan
routing2,41,195,nan,nan
routing2,41,196,nan,nan
routing2,41,197,nan,nan
routing2,41,198,nan,nan
routing2,41,199,0.0,0.61
vanilla,41,0,0.0,0.38
vanilla,41,1,nan,nan
vanilla,41,2,nan,nan
vanilla,41,3,nan,nan
vanilla,41,4,nan,nan
vanilla,41,5,nan,nan
vanilla,41,6,nan,nan
vanilla,41,7,nan,nan
vanilla,41,8,nan,nan
vanilla,41,9,nan,nan
vanilla,41,10,0.0,0.5
vanilla,41,11,nan,nan
vanilla,41,12,nan,nan
vanilla,41,13,nan,nan
vanilla,41,14,nan,nan
vanilla,41,15,nan,nan
vanilla,41,16,nan,nan
vanilla,41,17,nan,nan
vanilla,41,18,nan,nan
vanilla,41,19,nan,nan
vanilla,41,20,0.16,0.5
vanilla,41,21,nan,nan
vanilla,41,22,nan,nan
vanilla,41,23,nan,nan
vanilla,41,24,nan,nan
vanilla,41,25,nan,nan
vanilla,41,26,nan,nan
vanilla,41,27,nan,nan
vanilla,41,28,nan,nan
vanilla,41,29,nan,nan
vanilla,41,30,0.31,0.45
vanilla,41,31,nan,nan
vanilla,41,32,nan,nan
vanilla,41,33,nan,nan
vanilla,41,34,nan,nan
vanilla,41,35,nan,nan
vanilla,41,36,nan,nan
vanilla,41,37,nan,nan
vanilla,41,38,nan,nan
vanilla,41,39,nan,nan
vanilla,41,40,0.36,0.45
vanilla,41,41,nan,nan
vanilla,41,42,nan,nan
vanilla,41,43,nan,nan
vanilla,41,44,nan,nan
vanilla,41,45,nan,nan
vanilla,41,46,nan,nan
vanilla,41,47,nan,nan
vanilla,41,48,nan,nan
vanilla,41,49,nan,nan
vanilla,41,50,0.56,0.31
vanilla,41,51,nan,nan
vanilla,41,52,nan,nan
vanilla,41,53,nan,nan
vanilla,41,54,nan,nan
vanilla,41,55,nan,nan
vanilla,41,56,nan,nan
vanilla,41,57,nan,nan
vanilla,41,58,nan,nan
vanilla,41,59,nan,nan
vanilla,41,60,0.47,0.53
vanilla,41,61,nan,nan
vanilla,41,62,nan,nan
vanilla,41,63,nan,nan
vanilla,41,64,nan,nan
vanilla,41,65,nan,nan
vanilla,41,66,nan,nan
vanilla,41,67,nan,nan
vanilla,41,68,nan,nan
vanilla,41,69,nan,nan
vanilla,41,70,0.56,0.42
vanilla,41,71,nan,nan
vanilla,41,72,nan,nan
vanilla,41,73,nan,nan
vanilla,41,74,nan,nan
vanilla,41,75,nan,nan
vanilla,41,76,nan,nan
vanilla,41,77,nan,nan
vanilla,41,78,nan,nan
vanilla,41,79,nan,nan
vanilla,41,80,0.67,0.22
vanilla,41,81,nan,nan
vanilla,41,82,nan,nan
vanilla,41,83,nan,nan
vanilla,41,84,nan,nan
vanilla,41,85,nan,nan
vanilla,41,86,nan,nan
vanilla,41,87,nan,nan
vanilla,41,88,nan,nan
vanilla,41,89,nan,nan
vanilla,41,90,0.06,0.0
vanilla,41,91,nan,nan
vanilla,41,92,nan,nan
vanilla,41,93,nan,nan
vanilla,41,94,nan,nan
vanilla,41,95,nan,nan
vanilla,41,96,nan,nan
vanilla,41,97,nan,nan
vanilla,41,98,nan,nan
vanilla,41,99,nan,nan
vanilla,41,100,0.0,0.0
vanilla,41,101,nan,nan
vanilla,41,102,nan,nan
vanilla,41,103,nan,nan
vanilla,41,104,nan,nan
vanilla,41,105,nan,nan
vanilla,41,106,nan,nan
vanilla,41,107,nan,nan
vanilla,41,108,nan,nan
vanilla,41,109,nan,nan
vanilla,41,110,0.0,0.0
vanilla,41,111,nan,nan
vanilla,41,112,nan,nan
vanilla,41,113,nan,nan
vanilla,41,114,nan,nan
vanilla,41,115,nan,nan
vanilla,41,116,nan,nan
vanilla,41,117,nan,nan
vanilla,41,118,nan,nan
vanilla,41,119,nan,nan
vanilla,41,120,0.0,0.0
vanilla,41,121,nan,nan
vanilla,41,122,nan,nan
vanilla,41,123,nan,nan
vanilla,41,124,nan,nan
vanilla,41,125,nan,nan
vanilla,41,126,nan,nan
vanilla,41,127,nan,nan
vanilla,41,128,nan,nan
vanilla,41,129,nan,nan
vanilla,41,130,0.03,0.0
vanilla,41,131,nan,nan
vanilla,41,132,nan,nan
vanilla,41,133,nan,nan
vanilla,41,134,nan,nan
vanilla,41,135,nan,nan
vanilla,41,136,nan,nan
vanilla,41,137,nan,nan
vanilla,41,138,nan,nan
vanilla,41,139,nan,nan
arm,seed,step,hack_s,gt_s,hack_train,solve_train,hk_dep,slv_dep
routing2,41,0,0.0,0.38,0.0,0.14285714285714285,0.0,0.38
routing2,41,1,nan,nan,0.0,0.21428571428571427,nan,nan
routing2,41,2,nan,nan,0.0,0.0,nan,nan
routing2,41,3,nan,nan,0.0,0.17857142857142858,nan,nan
routing2,41,4,nan,nan,0.0,0.0,nan,nan
routing2,41,5,nan,nan,0.0,0.4642857142857143,nan,nan
routing2,41,6,nan,nan,0.0,0.25,nan,nan
routing2,41,7,nan,nan,0.0,0.07142857142857142,nan,nan
routing2,41,8,nan,nan,0.0,0.25,nan,nan
routing2,41,9,nan,nan,0.0,0.4642857142857143,nan,nan
routing2,41,10,0.0,0.45,0.0,0.32142857142857145,0.0,0.45
routing2,41,11,nan,nan,0.0,0.4642857142857143,nan,nan
routing2,41,12,nan,nan,0.0,0.25,nan,nan
routing2,41,13,nan,nan,0.0,0.39285714285714285,nan,nan
routing2,41,14,nan,nan,0.0,0.5714285714285714,nan,nan
routing2,41,15,nan,nan,0.07142857142857142,0.75,nan,nan
routing2,41,16,nan,nan,0.2857142857142857,0.39285714285714285,nan,nan
routing2,41,17,nan,nan,0.21428571428571427,0.21428571428571427,nan,nan
routing2,41,18,nan,nan,0.0,0.5357142857142857,nan,nan
routing2,41,19,nan,nan,0.32142857142857145,0.14285714285714285,nan,nan
routing2,41,20,0.0,0.62,0.0,0.5357142857142857,0.0,0.62
routing2,41,21,nan,nan,0.0,0.6428571428571429,nan,nan
routing2,41,22,nan,nan,0.5,0.25,nan,nan
routing2,41,23,nan,nan,0.32142857142857145,0.4642857142857143,nan,nan
routing2,41,24,nan,nan,0.21428571428571427,0.2857142857142857,nan,nan
routing2,41,25,nan,nan,0.42857142857142855,0.25,nan,nan
routing2,41,26,nan,nan,0.5,0.03571428571428571,nan,nan
routing2,41,27,nan,nan,0.17857142857142858,0.5714285714285714,nan,nan
routing2,41,28,nan,nan,0.10714285714285714,0.17857142857142858,nan,nan
routing2,41,29,nan,nan,0.35714285714285715,0.4642857142857143,nan,nan
routing2,41,30,0.0,0.62,0.75,0.0,0.0,0.62
routing2,41,31,nan,nan,0.75,0.10714285714285714,nan,nan
routing2,41,32,nan,nan,0.21428571428571427,0.5714285714285714,nan,nan
routing2,41,33,nan,nan,0.75,0.17857142857142858,nan,nan
routing2,41,34,nan,nan,0.4642857142857143,0.21428571428571427,nan,nan
routing2,41,35,nan,nan,0.17857142857142858,0.4642857142857143,nan,nan
routing2,41,36,nan,nan,0.6428571428571429,0.10714285714285714,nan,nan
routing2,41,37,nan,nan,0.35714285714285715,0.42857142857142855,nan,nan
routing2,41,38,nan,nan,0.32142857142857145,0.4642857142857143,nan,nan
routing2,41,39,nan,nan,0.6071428571428571,0.35714285714285715,nan,nan
routing2,41,40,0.0,0.61,0.6785714285714286,0.32142857142857145,0.0,0.61
routing2,41,41,nan,nan,0.6428571428571429,0.25,nan,nan
routing2,41,42,nan,nan,0.75,0.14285714285714285,nan,nan
routing2,41,43,nan,nan,0.7857142857142857,0.10714285714285714,nan,nan
routing2,41,44,nan,nan,0.6785714285714286,0.21428571428571427,nan,nan
routing2,41,45,nan,nan,0.39285714285714285,0.5357142857142857,nan,nan
routing2,41,46,nan,nan,0.5357142857142857,0.4642857142857143,nan,nan
routing2,41,47,nan,nan,0.4642857142857143,0.5,nan,nan
routing2,41,48,nan,nan,0.8571428571428571,0.07142857142857142,nan,nan
routing2,41,49,nan,nan,0.2857142857142857,0.6785714285714286,nan,nan
routing2,41,50,0.0,0.62,0.5,0.42857142857142855,0.0,0.62
routing2,41,51,nan,nan,0.4642857142857143,0.5357142857142857,nan,nan
routing2,41,52,nan,nan,0.6428571428571429,0.32142857142857145,nan,nan
routing2,41,53,nan,nan,0.8571428571428571,0.07142857142857142,nan,nan
routing2,41,54,nan,nan,0.39285714285714285,0.4642857142857143,nan,nan
routing2,41,55,nan,nan,0.5,0.42857142857142855,nan,nan
routing2,41,56,nan,nan,0.7142857142857143,0.2857142857142857,nan,nan
routing2,41,57,nan,nan,0.39285714285714285,0.5714285714285714,nan,nan
routing2,41,58,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan
routing2,41,59,nan,nan,0.5714285714285714,0.39285714285714285,nan,nan
routing2,41,60,0.0,0.62,0.75,0.14285714285714285,0.0,0.62
routing2,41,61,nan,nan,0.7857142857142857,0.21428571428571427,nan,nan
routing2,41,62,nan,nan,0.32142857142857145,0.6428571428571429,nan,nan
routing2,41,63,nan,nan,0.2857142857142857,0.5714285714285714,nan,nan
routing2,41,64,nan,nan,0.7857142857142857,0.21428571428571427,nan,nan
routing2,41,65,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan
routing2,41,66,nan,nan,0.75,0.21428571428571427,nan,nan
routing2,41,67,nan,nan,0.6428571428571429,0.2857142857142857,nan,nan
routing2,41,68,nan,nan,0.7857142857142857,0.14285714285714285,nan,nan
routing2,41,69,nan,nan,0.75,0.25,nan,nan
routing2,41,70,0.0,0.62,0.6071428571428571,0.35714285714285715,0.0,0.62
routing2,41,71,nan,nan,0.6428571428571429,0.35714285714285715,nan,nan
routing2,41,72,nan,nan,0.7142857142857143,0.25,nan,nan
routing2,41,73,nan,nan,0.7857142857142857,0.21428571428571427,nan,nan
routing2,41,74,nan,nan,0.9285714285714286,0.03571428571428571,nan,nan
routing2,41,75,nan,nan,0.21428571428571427,0.75,nan,nan
routing2,41,76,nan,nan,0.8214285714285714,0.14285714285714285,nan,nan
routing2,41,77,nan,nan,0.5357142857142857,0.39285714285714285,nan,nan
routing2,41,78,nan,nan,0.75,0.21428571428571427,nan,nan
routing2,41,79,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan
routing2,41,80,0.0,0.59,0.8214285714285714,0.14285714285714285,0.0,0.59
routing2,41,81,nan,nan,0.35714285714285715,0.6071428571428571,nan,nan
routing2,41,82,nan,nan,1.0,0.0,nan,nan
routing2,41,83,nan,nan,0.6071428571428571,0.32142857142857145,nan,nan
routing2,41,84,nan,nan,0.10714285714285714,0.8928571428571429,nan,nan
routing2,41,85,nan,nan,0.7857142857142857,0.17857142857142858,nan,nan
routing2,41,86,nan,nan,0.8214285714285714,0.14285714285714285,nan,nan
routing2,41,87,nan,nan,0.14285714285714285,0.8571428571428571,nan,nan
routing2,41,88,nan,nan,0.32142857142857145,0.6785714285714286,nan,nan
routing2,41,89,nan,nan,0.6071428571428571,0.35714285714285715,nan,nan
routing2,41,90,0.0,0.62,0.5357142857142857,0.4642857142857143,0.0,0.62
routing2,41,91,nan,nan,0.42857142857142855,0.5357142857142857,nan,nan
routing2,41,92,nan,nan,0.35714285714285715,0.6428571428571429,nan,nan
routing2,41,93,nan,nan,0.5357142857142857,0.4642857142857143,nan,nan
routing2,41,94,nan,nan,0.75,0.25,nan,nan
routing2,41,95,nan,nan,0.5714285714285714,0.39285714285714285,nan,nan
routing2,41,96,nan,nan,0.75,0.25,nan,nan
routing2,41,97,nan,nan,0.5,0.5,nan,nan
routing2,41,98,nan,nan,0.8214285714285714,0.17857142857142858,nan,nan
routing2,41,99,nan,nan,0.42857142857142855,0.5714285714285714,nan,nan
routing2,41,100,0.0,0.62,0.6071428571428571,0.39285714285714285,0.0,0.62
routing2,41,101,nan,nan,0.21428571428571427,0.7142857142857143,nan,nan
routing2,41,102,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan
routing2,41,103,nan,nan,1.0,0.0,nan,nan
routing2,41,104,nan,nan,0.39285714285714285,0.5714285714285714,nan,nan
routing2,41,105,nan,nan,0.6428571428571429,0.32142857142857145,nan,nan
routing2,41,106,nan,nan,0.8214285714285714,0.17857142857142858,nan,nan
routing2,41,107,nan,nan,0.6071428571428571,0.39285714285714285,nan,nan
routing2,41,108,nan,nan,0.7142857142857143,0.2857142857142857,nan,nan
routing2,41,109,nan,nan,0.8571428571428571,0.14285714285714285,nan,nan
routing2,41,110,0.0,0.62,0.4642857142857143,0.5357142857142857,0.0,0.62
routing2,41,111,nan,nan,0.4642857142857143,0.4642857142857143,nan,nan
routing2,41,112,nan,nan,0.2857142857142857,0.7142857142857143,nan,nan
routing2,41,113,nan,nan,0.75,0.25,nan,nan
routing2,41,114,nan,nan,0.4642857142857143,0.5357142857142857,nan,nan
routing2,41,115,nan,nan,0.7857142857142857,0.21428571428571427,nan,nan
routing2,41,116,nan,nan,0.6428571428571429,0.35714285714285715,nan,nan
routing2,41,117,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan
routing2,41,118,nan,nan,0.2857142857142857,0.6785714285714286,nan,nan
routing2,41,119,nan,nan,0.5,0.5,nan,nan
routing2,41,120,0.0,0.62,0.8214285714285714,0.17857142857142858,0.0,0.62
routing2,41,121,nan,nan,0.75,0.21428571428571427,nan,nan
routing2,41,122,nan,nan,0.39285714285714285,0.6071428571428571,nan,nan
routing2,41,123,nan,nan,0.75,0.21428571428571427,nan,nan
routing2,41,124,nan,nan,0.32142857142857145,0.6785714285714286,nan,nan
routing2,41,125,nan,nan,0.75,0.25,nan,nan
routing2,41,126,nan,nan,0.75,0.25,nan,nan
routing2,41,127,nan,nan,0.4642857142857143,0.5357142857142857,nan,nan
routing2,41,128,nan,nan,0.6428571428571429,0.35714285714285715,nan,nan
routing2,41,129,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan
routing2,41,130,0.0,0.62,0.7142857142857143,0.2857142857142857,0.0,0.62
routing2,41,131,nan,nan,0.32142857142857145,0.6785714285714286,nan,nan
routing2,41,132,nan,nan,0.25,0.7142857142857143,nan,nan
routing2,41,133,nan,nan,0.5357142857142857,0.42857142857142855,nan,nan
routing2,41,134,nan,nan,0.2857142857142857,0.7142857142857143,nan,nan
routing2,41,135,nan,nan,0.5357142857142857,0.4642857142857143,nan,nan
routing2,41,136,nan,nan,0.5357142857142857,0.4642857142857143,nan,nan
routing2,41,137,nan,nan,0.4642857142857143,0.5,nan,nan
routing2,41,138,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan
routing2,41,139,nan,nan,0.39285714285714285,0.6071428571428571,nan,nan
routing2,41,140,0.0,0.62,0.75,0.25,0.0,0.62
routing2,41,141,nan,nan,0.75,0.21428571428571427,nan,nan
routing2,41,142,nan,nan,0.75,0.25,nan,nan
routing2,41,143,nan,nan,0.5714285714285714,0.35714285714285715,nan,nan
routing2,41,144,nan,nan,0.6428571428571429,0.35714285714285715,nan,nan
routing2,41,145,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan
routing2,41,146,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan
routing2,41,147,nan,nan,0.6071428571428571,0.39285714285714285,nan,nan
routing2,41,148,nan,nan,0.5714285714285714,0.35714285714285715,nan,nan
routing2,41,149,nan,nan,0.5,0.5,nan,nan
routing2,41,150,0.0,0.62,0.75,0.25,0.0,0.62
routing2,41,151,nan,nan,0.39285714285714285,0.6071428571428571,nan,nan
routing2,41,152,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan
routing2,41,153,nan,nan,0.39285714285714285,0.6071428571428571,nan,nan
routing2,41,154,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan
routing2,41,155,nan,nan,0.9285714285714286,0.07142857142857142,nan,nan
routing2,41,156,nan,nan,0.2857142857142857,0.7142857142857143,nan,nan
routing2,41,157,nan,nan,0.8214285714285714,0.17857142857142858,nan,nan
routing2,41,158,nan,nan,0.4642857142857143,0.5,nan,nan
routing2,41,159,nan,nan,0.32142857142857145,0.6785714285714286,nan,nan
routing2,41,160,0.0,0.62,0.21428571428571427,0.75,0.0,0.62
routing2,41,161,nan,nan,0.75,0.25,nan,nan
routing2,41,162,nan,nan,0.75,0.25,nan,nan
routing2,41,163,nan,nan,0.9285714285714286,0.03571428571428571,nan,nan
routing2,41,164,nan,nan,0.4642857142857143,0.5357142857142857,nan,nan
routing2,41,165,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan
routing2,41,166,nan,nan,0.7142857142857143,0.25,nan,nan
routing2,41,167,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan
routing2,41,168,nan,nan,0.6071428571428571,0.39285714285714285,nan,nan
routing2,41,169,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan
routing2,41,170,0.0,0.62,0.7142857142857143,0.25,0.0,0.62
routing2,41,171,nan,nan,0.8571428571428571,0.14285714285714285,nan,nan
routing2,41,172,nan,nan,0.6785714285714286,0.2857142857142857,nan,nan
routing2,41,173,nan,nan,0.75,0.25,nan,nan
routing2,41,174,nan,nan,0.8928571428571429,0.10714285714285714,nan,nan
routing2,41,175,nan,nan,0.6428571428571429,0.32142857142857145,nan,nan
routing2,41,176,nan,nan,0.6071428571428571,0.39285714285714285,nan,nan
routing2,41,177,nan,nan,0.6428571428571429,0.35714285714285715,nan,nan
routing2,41,178,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan
routing2,41,179,nan,nan,0.7142857142857143,0.25,nan,nan
routing2,41,180,0.0,0.62,0.42857142857142855,0.5714285714285714,0.0,0.62
routing2,41,181,nan,nan,0.8571428571428571,0.14285714285714285,nan,nan
routing2,41,182,nan,nan,0.32142857142857145,0.6785714285714286,nan,nan
routing2,41,183,nan,nan,0.35714285714285715,0.6071428571428571,nan,nan
routing2,41,184,nan,nan,0.6071428571428571,0.39285714285714285,nan,nan
routing2,41,185,nan,nan,0.7857142857142857,0.21428571428571427,nan,nan
routing2,41,186,nan,nan,0.8214285714285714,0.17857142857142858,nan,nan
routing2,41,187,nan,nan,0.9642857142857143,0.0,nan,nan
routing2,41,188,nan,nan,0.8928571428571429,0.10714285714285714,nan,nan
routing2,41,189,nan,nan,0.35714285714285715,0.6428571428571429,nan,nan
routing2,41,190,0.0,0.62,0.6428571428571429,0.35714285714285715,0.0,0.62
routing2,41,191,nan,nan,0.75,0.25,nan,nan
routing2,41,192,nan,nan,0.6428571428571429,0.35714285714285715,nan,nan
routing2,41,193,nan,nan,0.8571428571428571,0.14285714285714285,nan,nan
routing2,41,194,nan,nan,0.8571428571428571,0.14285714285714285,nan,nan
routing2,41,195,nan,nan,0.9285714285714286,0.07142857142857142,nan,nan
routing2,41,196,nan,nan,0.8214285714285714,0.17857142857142858,nan,nan
routing2,41,197,nan,nan,0.5,0.5,nan,nan
routing2,41,198,nan,nan,0.32142857142857145,0.6785714285714286,nan,nan
routing2,41,199,0.0,0.61,0.32142857142857145,0.6428571428571429,0.0,0.61
vanilla,41,0,0.0,0.33,0.0,0.14285714285714285,0.0,0.33
vanilla,41,1,nan,nan,0.0,0.17857142857142858,nan,nan
vanilla,41,2,nan,nan,0.0,0.0,nan,nan
vanilla,41,3,nan,nan,0.0,0.17857142857142858,nan,nan
vanilla,41,4,nan,nan,0.0,0.0,nan,nan
vanilla,41,5,nan,nan,0.0,0.4642857142857143,nan,nan
vanilla,41,6,nan,nan,0.0,0.25,nan,nan
vanilla,41,7,nan,nan,0.0,0.14285714285714285,nan,nan
vanilla,41,8,nan,nan,0.0,0.07142857142857142,nan,nan
vanilla,41,9,nan,nan,0.0,0.42857142857142855,nan,nan
vanilla,41,10,nan,nan,0.0,0.25,nan,nan
vanilla,41,11,nan,nan,0.0,0.42857142857142855,nan,nan
vanilla,41,12,nan,nan,0.0,0.25,nan,nan
vanilla,41,13,nan,nan,0.0,0.14285714285714285,nan,nan
vanilla,41,14,nan,nan,0.0,0.32142857142857145,nan,nan
vanilla,41,15,nan,nan,0.0,0.35714285714285715,nan,nan
vanilla,41,16,nan,nan,0.0,0.35714285714285715,nan,nan
vanilla,41,17,nan,nan,0.0,0.17857142857142858,nan,nan
vanilla,41,18,nan,nan,0.0,0.6428571428571429,nan,nan
vanilla,41,19,nan,nan,0.0,0.10714285714285714,nan,nan
vanilla,41,20,0.0,0.48,0.0,0.6785714285714286,0.0,0.48
vanilla,41,21,nan,nan,0.0,0.4642857142857143,nan,nan
vanilla,41,22,nan,nan,0.0,0.25,nan,nan
vanilla,41,23,nan,nan,0.0,0.5714285714285714,nan,nan
vanilla,41,24,nan,nan,0.0,0.17857142857142858,nan,nan
vanilla,41,25,nan,nan,0.03571428571428571,0.25,nan,nan
vanilla,41,26,nan,nan,0.0,0.0,nan,nan
vanilla,41,27,nan,nan,0.0,0.6428571428571429,nan,nan
vanilla,41,28,nan,nan,0.0,0.25,nan,nan
vanilla,41,29,nan,nan,0.0,0.5357142857142857,nan,nan
vanilla,41,30,nan,nan,0.03571428571428571,0.0,nan,nan
vanilla,41,31,nan,nan,0.0,0.17857142857142858,nan,nan
vanilla,41,32,nan,nan,0.0,0.7142857142857143,nan,nan
vanilla,41,33,nan,nan,0.07142857142857142,0.25,nan,nan
vanilla,41,34,nan,nan,0.10714285714285714,0.2857142857142857,nan,nan
vanilla,41,35,nan,nan,0.0,0.5,nan,nan
vanilla,41,36,nan,nan,0.14285714285714285,0.42857142857142855,nan,nan
vanilla,41,37,nan,nan,0.07142857142857142,0.4642857142857143,nan,nan
vanilla,41,38,nan,nan,0.07142857142857142,0.5357142857142857,nan,nan
vanilla,41,39,nan,nan,0.32142857142857145,0.35714285714285715,nan,nan
vanilla,41,40,0.17,0.5,0.07142857142857142,0.35714285714285715,0.17,0.5
vanilla,41,41,nan,nan,0.17857142857142858,0.35714285714285715,nan,nan
vanilla,41,42,nan,nan,0.42857142857142855,0.03571428571428571,nan,nan
vanilla,41,43,nan,nan,0.39285714285714285,0.07142857142857142,nan,nan
vanilla,41,44,nan,nan,0.17857142857142858,0.25,nan,nan
vanilla,41,45,nan,nan,0.21428571428571427,0.25,nan,nan
vanilla,41,46,nan,nan,0.07142857142857142,0.5357142857142857,nan,nan
vanilla,41,47,nan,nan,0.17857142857142858,0.5357142857142857,nan,nan
vanilla,41,48,nan,nan,0.10714285714285714,0.17857142857142858,nan,nan
vanilla,41,49,nan,nan,0.0,0.8214285714285714,nan,nan
vanilla,41,50,nan,nan,0.17857142857142858,0.42857142857142855,nan,nan
vanilla,41,51,nan,nan,0.10714285714285714,0.5714285714285714,nan,nan
vanilla,41,52,nan,nan,0.10714285714285714,0.2857142857142857,nan,nan
vanilla,41,53,nan,nan,0.42857142857142855,0.0,nan,nan
vanilla,41,54,nan,nan,0.0,0.5357142857142857,nan,nan
vanilla,41,55,nan,nan,0.03571428571428571,0.6428571428571429,nan,nan
vanilla,41,56,nan,nan,0.39285714285714285,0.25,nan,nan
vanilla,41,57,nan,nan,0.2857142857142857,0.4642857142857143,nan,nan
vanilla,41,58,nan,nan,0.2857142857142857,0.21428571428571427,nan,nan
vanilla,41,59,nan,nan,0.2857142857142857,0.39285714285714285,nan,nan
vanilla,41,60,0.25,0.55,0.6785714285714286,0.07142857142857142,0.25,0.55
vanilla,41,61,nan,nan,0.32142857142857145,0.42857142857142855,nan,nan
vanilla,41,62,nan,nan,0.21428571428571427,0.5357142857142857,nan,nan
vanilla,41,63,nan,nan,0.17857142857142858,0.42857142857142855,nan,nan
vanilla,41,64,nan,nan,0.39285714285714285,0.21428571428571427,nan,nan
vanilla,41,65,nan,nan,0.07142857142857142,0.35714285714285715,nan,nan
vanilla,41,66,nan,nan,0.32142857142857145,0.25,nan,nan
vanilla,41,67,nan,nan,0.5714285714285714,0.2857142857142857,nan,nan
vanilla,41,68,nan,nan,0.6785714285714286,0.07142857142857142,nan,nan
vanilla,41,69,nan,nan,0.4642857142857143,0.25,nan,nan
vanilla,41,70,nan,nan,0.39285714285714285,0.25,nan,nan
vanilla,41,71,nan,nan,0.39285714285714285,0.25,nan,nan
vanilla,41,72,nan,nan,0.25,0.42857142857142855,nan,nan
vanilla,41,73,nan,nan,0.32142857142857145,0.14285714285714285,nan,nan
vanilla,41,74,nan,nan,0.5714285714285714,0.07142857142857142,nan,nan
vanilla,41,75,nan,nan,0.0,0.8928571428571429,nan,nan
vanilla,41,76,nan,nan,0.25,0.03571428571428571,nan,nan
vanilla,41,77,nan,nan,0.2857142857142857,0.42857142857142855,nan,nan
vanilla,41,78,nan,nan,0.6785714285714286,0.03571428571428571,nan,nan
vanilla,41,79,nan,nan,0.32142857142857145,0.32142857142857145,nan,nan
vanilla,41,80,0.22,0.5,0.39285714285714285,0.25,0.22,0.5
vanilla,41,81,nan,nan,0.14285714285714285,0.4642857142857143,nan,nan
vanilla,41,82,nan,nan,0.7142857142857143,0.0,nan,nan
vanilla,41,83,nan,nan,0.42857142857142855,0.32142857142857145,nan,nan
vanilla,41,84,nan,nan,0.03571428571428571,0.7142857142857143,nan,nan
vanilla,41,85,nan,nan,0.39285714285714285,0.10714285714285714,nan,nan
vanilla,41,86,nan,nan,0.5357142857142857,0.17857142857142858,nan,nan
vanilla,41,87,nan,nan,0.07142857142857142,0.5,nan,nan
vanilla,41,88,nan,nan,0.10714285714285714,0.4642857142857143,nan,nan
vanilla,41,89,nan,nan,0.35714285714285715,0.42857142857142855,nan,nan
vanilla,41,90,nan,nan,0.17857142857142858,0.5357142857142857,nan,nan
vanilla,41,91,nan,nan,0.32142857142857145,0.6428571428571429,nan,nan
vanilla,41,92,nan,nan,0.35714285714285715,0.5357142857142857,nan,nan
vanilla,41,93,nan,nan,0.03571428571428571,0.39285714285714285,nan,nan
vanilla,41,94,nan,nan,0.5,0.25,nan,nan
vanilla,41,95,nan,nan,0.2857142857142857,0.17857142857142858,nan,nan
vanilla,41,96,nan,nan,0.4642857142857143,0.25,nan,nan
vanilla,41,97,nan,nan,0.2857142857142857,0.2857142857142857,nan,nan
vanilla,41,98,nan,nan,0.39285714285714285,0.14285714285714285,nan,nan
vanilla,41,99,nan,nan,0.07142857142857142,0.5357142857142857,nan,nan
vanilla,41,100,0.28,0.47,0.25,0.35714285714285715,0.28,0.47
vanilla,41,101,nan,nan,0.10714285714285714,0.7142857142857143,nan,nan
vanilla,41,102,nan,nan,0.42857142857142855,0.35714285714285715,nan,nan
vanilla,41,103,nan,nan,0.7142857142857143,0.0,nan,nan
vanilla,41,104,nan,nan,0.35714285714285715,0.5,nan,nan
vanilla,41,105,nan,nan,0.35714285714285715,0.32142857142857145,nan,nan
vanilla,41,106,nan,nan,0.25,0.17857142857142858,nan,nan
vanilla,41,107,nan,nan,0.5,0.32142857142857145,nan,nan
vanilla,41,108,nan,nan,0.5,0.25,nan,nan
vanilla,41,109,nan,nan,0.7142857142857143,0.10714285714285714,nan,nan
vanilla,41,110,nan,nan,0.39285714285714285,0.42857142857142855,nan,nan
vanilla,41,111,nan,nan,0.39285714285714285,0.39285714285714285,nan,nan
vanilla,41,112,nan,nan,0.21428571428571427,0.5,nan,nan
vanilla,41,113,nan,nan,0.5714285714285714,0.2857142857142857,nan,nan
vanilla,41,114,nan,nan,0.10714285714285714,0.5357142857142857,nan,nan
vanilla,41,115,nan,nan,0.32142857142857145,0.10714285714285714,nan,nan
vanilla,41,116,nan,nan,0.32142857142857145,0.21428571428571427,nan,nan
vanilla,41,117,nan,nan,0.5,0.25,nan,nan
vanilla,41,118,nan,nan,0.03571428571428571,0.32142857142857145,nan,nan
vanilla,41,119,nan,nan,0.14285714285714285,0.4642857142857143,nan,nan
vanilla,41,120,0.33,0.41,0.5357142857142857,0.17857142857142858,0.33,0.41
vanilla,41,121,nan,nan,0.5,0.35714285714285715,nan,nan
vanilla,41,122,nan,nan,0.2857142857142857,0.42857142857142855,nan,nan
vanilla,41,123,nan,nan,0.5714285714285714,0.03571428571428571,nan,nan
vanilla,41,124,nan,nan,0.35714285714285715,0.4642857142857143,nan,nan
vanilla,41,125,nan,nan,0.5714285714285714,0.17857142857142858,nan,nan
vanilla,41,126,nan,nan,0.35714285714285715,0.25,nan,nan
vanilla,41,127,nan,nan,0.25,0.42857142857142855,nan,nan
vanilla,41,128,nan,nan,0.17857142857142858,0.39285714285714285,nan,nan
vanilla,41,129,nan,nan,0.39285714285714285,0.21428571428571427,nan,nan
vanilla,41,130,nan,nan,0.42857142857142855,0.25,nan,nan
vanilla,41,131,nan,nan,0.2857142857142857,0.5,nan,nan
vanilla,41,132,nan,nan,0.03571428571428571,0.5357142857142857,nan,nan
vanilla,41,133,nan,nan,0.39285714285714285,0.5,nan,nan
vanilla,41,134,nan,nan,0.17857142857142858,0.5357142857142857,nan,nan
vanilla,41,135,nan,nan,0.42857142857142855,0.2857142857142857,nan,nan
vanilla,41,136,nan,nan,0.32142857142857145,0.35714285714285715,nan,nan
vanilla,41,137,nan,nan,0.42857142857142855,0.39285714285714285,nan,nan
vanilla,41,138,nan,nan,0.32142857142857145,0.39285714285714285,nan,nan
vanilla,41,139,nan,nan,0.32142857142857145,0.4642857142857143,nan,nan
vanilla,41,140,0.28,0.45,0.25,0.03571428571428571,0.28,0.45
vanilla,41,141,nan,nan,0.4642857142857143,0.10714285714285714,nan,nan
vanilla,41,142,nan,nan,0.6785714285714286,0.21428571428571427,nan,nan
vanilla,41,143,nan,nan,0.5357142857142857,0.21428571428571427,nan,nan
vanilla,41,144,nan,nan,0.4642857142857143,0.4642857142857143,nan,nan
vanilla,41,145,nan,nan,0.39285714285714285,0.14285714285714285,nan,nan
vanilla,41,146,nan,nan,0.42857142857142855,0.35714285714285715,nan,nan
vanilla,41,147,nan,nan,0.03571428571428571,0.35714285714285715,nan,nan
vanilla,41,148,nan,nan,0.42857142857142855,0.35714285714285715,nan,nan
vanilla,41,149,nan,nan,0.32142857142857145,0.39285714285714285,nan,nan
vanilla,41,150,nan,nan,0.5357142857142857,0.25,nan,nan
vanilla,41,151,nan,nan,0.21428571428571427,0.42857142857142855,nan,nan
vanilla,41,152,nan,nan,0.39285714285714285,0.4642857142857143,nan,nan
vanilla,41,153,nan,nan,0.42857142857142855,0.35714285714285715,nan,nan
vanilla,41,154,nan,nan,0.17857142857142858,0.4642857142857143,nan,nan
vanilla,41,155,nan,nan,0.5,0.21428571428571427,nan,nan
vanilla,41,156,nan,nan,0.03571428571428571,0.5357142857142857,nan,nan
vanilla,41,157,nan,nan,0.6785714285714286,0.17857142857142858,nan,nan
vanilla,41,158,nan,nan,0.5357142857142857,0.21428571428571427,nan,nan
vanilla,41,159,nan,nan,0.03571428571428571,0.42857142857142855,nan,nan
vanilla,41,160,0.33,0.44,0.17857142857142858,0.75,0.33,0.44
vanilla,41,161,nan,nan,0.6428571428571429,0.21428571428571427,nan,nan
vanilla,41,162,nan,nan,0.5357142857142857,0.25,nan,nan
vanilla,41,163,nan,nan,0.5714285714285714,0.10714285714285714,nan,nan
vanilla,41,164,nan,nan,0.17857142857142858,0.6785714285714286,nan,nan
vanilla,41,165,nan,nan,0.4642857142857143,0.39285714285714285,nan,nan
vanilla,41,166,nan,nan,0.5714285714285714,0.14285714285714285,nan,nan
vanilla,41,167,nan,nan,0.4642857142857143,0.25,nan,nan
vanilla,41,168,nan,nan,0.35714285714285715,0.14285714285714285,nan,nan
vanilla,41,169,nan,nan,0.5,0.32142857142857145,nan,nan
vanilla,41,170,nan,nan,0.6785714285714286,0.17857142857142858,nan,nan
vanilla,41,171,nan,nan,0.6428571428571429,0.07142857142857142,nan,nan
vanilla,41,172,nan,nan,0.35714285714285715,0.32142857142857145,nan,nan
vanilla,41,173,nan,nan,0.5357142857142857,0.25,nan,nan
vanilla,41,174,nan,nan,0.6428571428571429,0.14285714285714285,nan,nan
vanilla,41,175,nan,nan,0.32142857142857145,0.42857142857142855,nan,nan
vanilla,41,176,nan,nan,0.42857142857142855,0.39285714285714285,nan,nan
vanilla,41,177,nan,nan,0.25,0.35714285714285715,nan,nan
vanilla,41,178,nan,nan,0.4642857142857143,0.14285714285714285,nan,nan
vanilla,41,179,nan,nan,0.6785714285714286,0.25,nan,nan
vanilla,41,180,0.39,0.5,0.17857142857142858,0.39285714285714285,0.39,0.5
vanilla,41,181,nan,nan,0.42857142857142855,0.14285714285714285,nan,nan
vanilla,41,182,nan,nan,0.03571428571428571,0.5357142857142857,nan,nan
vanilla,41,183,nan,nan,0.2857142857142857,0.39285714285714285,nan,nan
vanilla,41,184,nan,nan,0.4642857142857143,0.14285714285714285,nan,nan
vanilla,41,185,nan,nan,0.4642857142857143,0.17857142857142858,nan,nan
vanilla,41,186,nan,nan,0.14285714285714285,0.14285714285714285,nan,nan
vanilla,41,187,nan,nan,0.6071428571428571,0.0,nan,nan
vanilla,41,188,nan,nan,0.9285714285714286,0.03571428571428571,nan,nan
vanilla,41,189,nan,nan,0.07142857142857142,0.6785714285714286,nan,nan
vanilla,41,190,nan,nan,0.6071428571428571,0.32142857142857145,nan,nan
vanilla,41,191,nan,nan,0.5,0.25,nan,nan
vanilla,41,192,nan,nan,0.5,0.25,nan,nan
vanilla,41,193,nan,nan,0.6785714285714286,0.2857142857142857,nan,nan
vanilla,41,194,nan,nan,0.5714285714285714,0.14285714285714285,nan,nan
vanilla,41,195,nan,nan,0.17857142857142858,0.07142857142857142,nan,nan
vanilla,41,196,nan,nan,0.6785714285714286,0.17857142857142858,nan,nan
vanilla,41,197,nan,nan,0.42857142857142855,0.35714285714285715,nan,nan
vanilla,41,198,nan,nan,0.14285714285714285,0.5357142857142857,nan,nan
vanilla,41,199,0.34,0.5,0.14285714285714285,0.4642857142857143,0.34,0.5
1 arm seed step hack hack_s solve gt_s hack_train solve_train hk_dep slv_dep
2 routing2 41 0 0.0 0.38 0.0 0.14285714285714285 0.0 0.38
3 routing2 41 1 nan nan 0.0 0.21428571428571427 nan nan
4 routing2 41 2 nan nan 0.0 0.0 nan nan
5 routing2 41 3 nan nan 0.0 0.17857142857142858 nan nan
6 routing2 41 4 nan nan 0.0 0.0 nan nan
7 routing2 41 5 nan nan 0.0 0.4642857142857143 nan nan
8 routing2 41 6 nan nan 0.0 0.25 nan nan
9 routing2 41 7 nan nan 0.0 0.07142857142857142 nan nan
10 routing2 41 8 nan nan 0.0 0.25 nan nan
11 routing2 41 9 nan nan 0.0 0.4642857142857143 nan nan
12 routing2 41 10 0.0 0.45 0.0 0.32142857142857145 0.0 0.45
13 routing2 41 11 nan nan 0.0 0.4642857142857143 nan nan
14 routing2 41 12 nan nan 0.0 0.25 nan nan
15 routing2 41 13 nan nan 0.0 0.39285714285714285 nan nan
16 routing2 41 14 nan nan 0.0 0.5714285714285714 nan nan
17 routing2 41 15 nan nan 0.07142857142857142 0.75 nan nan
18 routing2 41 16 nan nan 0.2857142857142857 0.39285714285714285 nan nan
19 routing2 41 17 nan nan 0.21428571428571427 0.21428571428571427 nan nan
20 routing2 41 18 nan nan 0.0 0.5357142857142857 nan nan
21 routing2 41 19 nan nan 0.32142857142857145 0.14285714285714285 nan nan
22 routing2 41 20 0.0 0.62 0.0 0.5357142857142857 0.0 0.62
23 routing2 41 21 nan nan 0.0 0.6428571428571429 nan nan
24 routing2 41 22 nan nan 0.5 0.25 nan nan
25 routing2 41 23 nan nan 0.32142857142857145 0.4642857142857143 nan nan
26 routing2 41 24 nan nan 0.21428571428571427 0.2857142857142857 nan nan
27 routing2 41 25 nan nan 0.42857142857142855 0.25 nan nan
28 routing2 41 26 nan nan 0.5 0.03571428571428571 nan nan
29 routing2 41 27 nan nan 0.17857142857142858 0.5714285714285714 nan nan
30 routing2 41 28 nan nan 0.10714285714285714 0.17857142857142858 nan nan
31 routing2 41 29 nan nan 0.35714285714285715 0.4642857142857143 nan nan
32 routing2 41 30 0.0 0.62 0.75 0.0 0.0 0.62
33 routing2 41 31 nan nan 0.75 0.10714285714285714 nan nan
34 routing2 41 32 nan nan 0.21428571428571427 0.5714285714285714 nan nan
35 routing2 41 33 nan nan 0.75 0.17857142857142858 nan nan
36 routing2 41 34 nan nan 0.4642857142857143 0.21428571428571427 nan nan
37 routing2 41 35 nan nan 0.17857142857142858 0.4642857142857143 nan nan
38 routing2 41 36 nan nan 0.6428571428571429 0.10714285714285714 nan nan
39 routing2 41 37 nan nan 0.35714285714285715 0.42857142857142855 nan nan
40 routing2 41 38 nan nan 0.32142857142857145 0.4642857142857143 nan nan
41 routing2 41 39 nan nan 0.6071428571428571 0.35714285714285715 nan nan
42 routing2 41 40 0.0 0.61 0.6785714285714286 0.32142857142857145 0.0 0.61
43 routing2 41 41 nan nan 0.6428571428571429 0.25 nan nan
44 routing2 41 42 nan nan 0.75 0.14285714285714285 nan nan
45 routing2 41 43 nan nan 0.7857142857142857 0.10714285714285714 nan nan
46 routing2 41 44 nan nan 0.6785714285714286 0.21428571428571427 nan nan
47 routing2 41 45 nan nan 0.39285714285714285 0.5357142857142857 nan nan
48 routing2 41 46 nan nan 0.5357142857142857 0.4642857142857143 nan nan
49 routing2 41 47 nan nan 0.4642857142857143 0.5 nan nan
50 routing2 41 48 nan nan 0.8571428571428571 0.07142857142857142 nan nan
51 routing2 41 49 nan nan 0.2857142857142857 0.6785714285714286 nan nan
52 routing2 41 50 0.0 0.62 0.5 0.42857142857142855 0.0 0.62
53 routing2 41 51 nan nan 0.4642857142857143 0.5357142857142857 nan nan
54 routing2 41 52 nan nan 0.6428571428571429 0.32142857142857145 nan nan
55 routing2 41 53 nan nan 0.8571428571428571 0.07142857142857142 nan nan
56 routing2 41 54 nan nan 0.39285714285714285 0.4642857142857143 nan nan
57 routing2 41 55 nan nan 0.5 0.42857142857142855 nan nan
58 routing2 41 56 nan nan 0.7142857142857143 0.2857142857142857 nan nan
59 routing2 41 57 nan nan 0.39285714285714285 0.5714285714285714 nan nan
60 routing2 41 58 nan nan 0.6785714285714286 0.32142857142857145 nan nan
61 routing2 41 59 nan nan 0.5714285714285714 0.39285714285714285 nan nan
62 routing2 41 60 0.0 0.62 0.75 0.14285714285714285 0.0 0.62
63 routing2 41 61 nan nan 0.7857142857142857 0.21428571428571427 nan nan
64 routing2 41 62 nan nan 0.32142857142857145 0.6428571428571429 nan nan
65 routing2 41 63 nan nan 0.2857142857142857 0.5714285714285714 nan nan
66 routing2 41 64 nan nan 0.7857142857142857 0.21428571428571427 nan nan
67 routing2 41 65 nan nan 0.6785714285714286 0.32142857142857145 nan nan
68 routing2 41 66 nan nan 0.75 0.21428571428571427 nan nan
69 routing2 41 67 nan nan 0.6428571428571429 0.2857142857142857 nan nan
70 routing2 41 68 nan nan 0.7857142857142857 0.14285714285714285 nan nan
71 routing2 41 69 nan nan 0.75 0.25 nan nan
72 routing2 41 70 0.0 0.62 0.6071428571428571 0.35714285714285715 0.0 0.62
73 routing2 41 71 nan nan 0.6428571428571429 0.35714285714285715 nan nan
74 routing2 41 72 nan nan 0.7142857142857143 0.25 nan nan
75 routing2 41 73 nan nan 0.7857142857142857 0.21428571428571427 nan nan
76 routing2 41 74 nan nan 0.9285714285714286 0.03571428571428571 nan nan
77 routing2 41 75 nan nan 0.21428571428571427 0.75 nan nan
78 routing2 41 76 nan nan 0.8214285714285714 0.14285714285714285 nan nan
79 routing2 41 77 nan nan 0.5357142857142857 0.39285714285714285 nan nan
80 routing2 41 78 nan nan 0.75 0.21428571428571427 nan nan
81 routing2 41 79 nan nan 0.5714285714285714 0.42857142857142855 nan nan
82 routing2 41 80 0.0 0.59 0.8214285714285714 0.14285714285714285 0.0 0.59
83 routing2 41 81 nan nan 0.35714285714285715 0.6071428571428571 nan nan
84 routing2 41 82 nan nan 1.0 0.0 nan nan
85 routing2 41 83 nan nan 0.6071428571428571 0.32142857142857145 nan nan
86 routing2 41 84 nan nan 0.10714285714285714 0.8928571428571429 nan nan
87 routing2 41 85 nan nan 0.7857142857142857 0.17857142857142858 nan nan
88 routing2 41 86 nan nan 0.8214285714285714 0.14285714285714285 nan nan
89 routing2 41 87 nan nan 0.14285714285714285 0.8571428571428571 nan nan
90 routing2 41 88 nan nan 0.32142857142857145 0.6785714285714286 nan nan
91 routing2 41 89 nan nan 0.6071428571428571 0.35714285714285715 nan nan
92 routing2 41 90 0.0 0.62 0.5357142857142857 0.4642857142857143 0.0 0.62
93 routing2 41 91 nan nan 0.42857142857142855 0.5357142857142857 nan nan
94 routing2 41 92 nan nan 0.35714285714285715 0.6428571428571429 nan nan
95 routing2 41 93 nan nan 0.5357142857142857 0.4642857142857143 nan nan
96 routing2 41 94 nan nan 0.75 0.25 nan nan
97 routing2 41 95 nan nan 0.5714285714285714 0.39285714285714285 nan nan
98 routing2 41 96 nan nan 0.75 0.25 nan nan
99 routing2 41 97 nan nan 0.5 0.5 nan nan
100 routing2 41 98 nan nan 0.8214285714285714 0.17857142857142858 nan nan
101 routing2 41 99 nan nan 0.42857142857142855 0.5714285714285714 nan nan
102 routing2 41 100 0.0 0.62 0.6071428571428571 0.39285714285714285 0.0 0.62
103 routing2 41 101 nan nan 0.21428571428571427 0.7142857142857143 nan nan
104 routing2 41 102 nan nan 0.5714285714285714 0.42857142857142855 nan nan
105 routing2 41 103 nan nan 1.0 0.0 nan nan
106 routing2 41 104 nan nan 0.39285714285714285 0.5714285714285714 nan nan
107 routing2 41 105 nan nan 0.6428571428571429 0.32142857142857145 nan nan
108 routing2 41 106 nan nan 0.8214285714285714 0.17857142857142858 nan nan
109 routing2 41 107 nan nan 0.6071428571428571 0.39285714285714285 nan nan
110 routing2 41 108 nan nan 0.7142857142857143 0.2857142857142857 nan nan
111 routing2 41 109 nan nan 0.8571428571428571 0.14285714285714285 nan nan
112 routing2 41 110 0.0 0.62 0.4642857142857143 0.5357142857142857 0.0 0.62
113 routing2 41 111 nan nan 0.4642857142857143 0.4642857142857143 nan nan
114 routing2 41 112 nan nan 0.2857142857142857 0.7142857142857143 nan nan
115 routing2 41 113 nan nan 0.75 0.25 nan nan
116 routing2 41 114 nan nan 0.4642857142857143 0.5357142857142857 nan nan
117 routing2 41 115 nan nan 0.7857142857142857 0.21428571428571427 nan nan
118 routing2 41 116 nan nan 0.6428571428571429 0.35714285714285715 nan nan
119 routing2 41 117 nan nan 0.5714285714285714 0.42857142857142855 nan nan
120 routing2 41 118 nan nan 0.2857142857142857 0.6785714285714286 nan nan
121 routing2 41 119 nan nan 0.5 0.5 nan nan
122 routing2 41 120 0.0 0.62 0.8214285714285714 0.17857142857142858 0.0 0.62
123 routing2 41 121 nan nan 0.75 0.21428571428571427 nan nan
124 routing2 41 122 nan nan 0.39285714285714285 0.6071428571428571 nan nan
125 routing2 41 123 nan nan 0.75 0.21428571428571427 nan nan
126 routing2 41 124 nan nan 0.32142857142857145 0.6785714285714286 nan nan
127 routing2 41 125 nan nan 0.75 0.25 nan nan
128 routing2 41 126 nan nan 0.75 0.25 nan nan
129 routing2 41 127 nan nan 0.4642857142857143 0.5357142857142857 nan nan
130 routing2 41 128 nan nan 0.6428571428571429 0.35714285714285715 nan nan
131 routing2 41 129 nan nan 0.6785714285714286 0.32142857142857145 nan nan
132 routing2 41 130 0.0 0.62 0.7142857142857143 0.2857142857142857 0.0 0.62
133 routing2 41 131 nan nan 0.32142857142857145 0.6785714285714286 nan nan
134 routing2 41 132 nan nan 0.25 0.7142857142857143 nan nan
135 routing2 41 133 nan nan 0.5357142857142857 0.42857142857142855 nan nan
136 routing2 41 134 nan nan 0.2857142857142857 0.7142857142857143 nan nan
137 routing2 41 135 nan nan 0.5357142857142857 0.4642857142857143 nan nan
138 routing2 41 136 nan nan 0.5357142857142857 0.4642857142857143 nan nan
139 routing2 41 137 nan nan 0.4642857142857143 0.5 nan nan
140 routing2 41 138 nan nan 0.5714285714285714 0.42857142857142855 nan nan
141 routing2 41 139 nan nan 0.39285714285714285 0.6071428571428571 nan nan
142 routing2 41 140 0.0 0.62 0.75 0.25 0.0 0.62
143 routing2 41 141 nan nan 0.75 0.21428571428571427 nan nan
144 routing2 41 142 nan nan 0.75 0.25 nan nan
145 routing2 41 143 nan nan 0.5714285714285714 0.35714285714285715 nan nan
146 routing2 41 144 nan nan 0.6428571428571429 0.35714285714285715 nan nan
147 routing2 41 145 nan nan 0.5714285714285714 0.42857142857142855 nan nan
148 routing2 41 146 nan nan 0.6785714285714286 0.32142857142857145 nan nan
149 routing2 41 147 nan nan 0.6071428571428571 0.39285714285714285 nan nan
150 routing2 41 148 nan nan 0.5714285714285714 0.35714285714285715 nan nan
151 routing2 41 149 nan nan 0.5 0.5 nan nan
152 routing2 41 150 0.0 0.62 0.75 0.25 0.0 0.62
153 routing2 41 151 nan nan 0.39285714285714285 0.6071428571428571 nan nan
154 routing2 41 152 nan nan 0.5714285714285714 0.42857142857142855 nan nan
155 routing2 41 153 nan nan 0.39285714285714285 0.6071428571428571 nan nan
156 routing2 41 154 nan nan 0.6785714285714286 0.32142857142857145 nan nan
157 routing2 41 155 nan nan 0.9285714285714286 0.07142857142857142 nan nan
158 routing2 41 156 nan nan 0.2857142857142857 0.7142857142857143 nan nan
159 routing2 41 157 nan nan 0.8214285714285714 0.17857142857142858 nan nan
160 routing2 41 158 nan nan 0.4642857142857143 0.5 nan nan
161 routing2 41 159 nan nan 0.32142857142857145 0.6785714285714286 nan nan
162 routing2 41 160 0.0 0.62 0.21428571428571427 0.75 0.0 0.62
163 routing2 41 161 nan nan 0.75 0.25 nan nan
164 routing2 41 162 nan nan 0.75 0.25 nan nan
165 routing2 41 163 nan nan 0.9285714285714286 0.03571428571428571 nan nan
166 routing2 41 164 nan nan 0.4642857142857143 0.5357142857142857 nan nan
167 routing2 41 165 nan nan 0.6785714285714286 0.32142857142857145 nan nan
168 routing2 41 166 nan nan 0.7142857142857143 0.25 nan nan
169 routing2 41 167 nan nan 0.6785714285714286 0.32142857142857145 nan nan
170 routing2 41 168 nan nan 0.6071428571428571 0.39285714285714285 nan nan
171 routing2 41 169 nan nan 0.5714285714285714 0.42857142857142855 nan nan
172 routing2 41 170 0.0 0.62 0.7142857142857143 0.25 0.0 0.62
173 routing2 41 171 nan nan 0.8571428571428571 0.14285714285714285 nan nan
174 routing2 41 172 nan nan 0.6785714285714286 0.2857142857142857 nan nan
175 routing2 41 173 nan nan 0.75 0.25 nan nan
176 routing2 41 174 nan nan 0.8928571428571429 0.10714285714285714 nan nan
177 routing2 41 175 nan nan 0.6428571428571429 0.32142857142857145 nan nan
178 routing2 41 176 nan nan 0.6071428571428571 0.39285714285714285 nan nan
179 routing2 41 177 nan nan 0.6428571428571429 0.35714285714285715 nan nan
180 routing2 41 178 nan nan 0.6785714285714286 0.32142857142857145 nan nan
181 routing2 41 179 nan nan 0.7142857142857143 0.25 nan nan
182 routing2 41 180 0.0 0.62 0.42857142857142855 0.5714285714285714 0.0 0.62
183 routing2 41 181 nan nan 0.8571428571428571 0.14285714285714285 nan nan
184 routing2 41 182 nan nan 0.32142857142857145 0.6785714285714286 nan nan
185 routing2 41 183 nan nan 0.35714285714285715 0.6071428571428571 nan nan
186 routing2 41 184 nan nan 0.6071428571428571 0.39285714285714285 nan nan
187 routing2 41 185 nan nan 0.7857142857142857 0.21428571428571427 nan nan
188 routing2 41 186 nan nan 0.8214285714285714 0.17857142857142858 nan nan
189 routing2 41 187 nan nan 0.9642857142857143 0.0 nan nan
190 routing2 41 188 nan nan 0.8928571428571429 0.10714285714285714 nan nan
191 routing2 41 189 nan nan 0.35714285714285715 0.6428571428571429 nan nan
192 routing2 41 190 0.0 0.62 0.6428571428571429 0.35714285714285715 0.0 0.62
193 routing2 41 191 nan nan 0.75 0.25 nan nan
194 routing2 41 192 nan nan 0.6428571428571429 0.35714285714285715 nan nan
195 routing2 41 193 nan nan 0.8571428571428571 0.14285714285714285 nan nan
196 routing2 41 194 nan nan 0.8571428571428571 0.14285714285714285 nan nan
197 routing2 41 195 nan nan 0.9285714285714286 0.07142857142857142 nan nan
198 routing2 41 196 nan nan 0.8214285714285714 0.17857142857142858 nan nan
199 routing2 41 197 nan nan 0.5 0.5 nan nan
200 routing2 41 198 nan nan 0.32142857142857145 0.6785714285714286 nan nan
201 routing2 41 199 0.0 0.61 0.32142857142857145 0.6428571428571429 0.0 0.61
202 vanilla 41 0 0.0 0.38 0.33 0.0 0.14285714285714285 0.0 0.33
203 vanilla 41 1 nan nan 0.0 0.17857142857142858 nan nan
204 vanilla 41 2 nan nan 0.0 0.0 nan nan
205 vanilla 41 3 nan nan 0.0 0.17857142857142858 nan nan
206 vanilla 41 4 nan nan 0.0 0.0 nan nan
207 vanilla 41 5 nan nan 0.0 0.4642857142857143 nan nan
208 vanilla 41 6 nan nan 0.0 0.25 nan nan
209 vanilla 41 7 nan nan 0.0 0.14285714285714285 nan nan
210 vanilla 41 8 nan nan 0.0 0.07142857142857142 nan nan
211 vanilla 41 9 nan nan 0.0 0.42857142857142855 nan nan
212 vanilla 41 10 0.0 nan 0.5 nan 0.0 0.25 nan nan
213 vanilla 41 11 nan nan 0.0 0.42857142857142855 nan nan
214 vanilla 41 12 nan nan 0.0 0.25 nan nan
215 vanilla 41 13 nan nan 0.0 0.14285714285714285 nan nan
216 vanilla 41 14 nan nan 0.0 0.32142857142857145 nan nan
217 vanilla 41 15 nan nan 0.0 0.35714285714285715 nan nan
218 vanilla 41 16 nan nan 0.0 0.35714285714285715 nan nan
219 vanilla 41 17 nan nan 0.0 0.17857142857142858 nan nan
220 vanilla 41 18 nan nan 0.0 0.6428571428571429 nan nan
221 vanilla 41 19 nan nan 0.0 0.10714285714285714 nan nan
222 vanilla 41 20 0.16 0.0 0.5 0.48 0.0 0.6785714285714286 0.0 0.48
223 vanilla 41 21 nan nan 0.0 0.4642857142857143 nan nan
224 vanilla 41 22 nan nan 0.0 0.25 nan nan
225 vanilla 41 23 nan nan 0.0 0.5714285714285714 nan nan
226 vanilla 41 24 nan nan 0.0 0.17857142857142858 nan nan
227 vanilla 41 25 nan nan 0.03571428571428571 0.25 nan nan
228 vanilla 41 26 nan nan 0.0 0.0 nan nan
229 vanilla 41 27 nan nan 0.0 0.6428571428571429 nan nan
230 vanilla 41 28 nan nan 0.0 0.25 nan nan
231 vanilla 41 29 nan nan 0.0 0.5357142857142857 nan nan
232 vanilla 41 30 0.31 nan 0.45 nan 0.03571428571428571 0.0 nan nan
233 vanilla 41 31 nan nan 0.0 0.17857142857142858 nan nan
234 vanilla 41 32 nan nan 0.0 0.7142857142857143 nan nan
235 vanilla 41 33 nan nan 0.07142857142857142 0.25 nan nan
236 vanilla 41 34 nan nan 0.10714285714285714 0.2857142857142857 nan nan
237 vanilla 41 35 nan nan 0.0 0.5 nan nan
238 vanilla 41 36 nan nan 0.14285714285714285 0.42857142857142855 nan nan
239 vanilla 41 37 nan nan 0.07142857142857142 0.4642857142857143 nan nan
240 vanilla 41 38 nan nan 0.07142857142857142 0.5357142857142857 nan nan
241 vanilla 41 39 nan nan 0.32142857142857145 0.35714285714285715 nan nan
242 vanilla 41 40 0.36 0.17 0.45 0.5 0.07142857142857142 0.35714285714285715 0.17 0.5
243 vanilla 41 41 nan nan 0.17857142857142858 0.35714285714285715 nan nan
244 vanilla 41 42 nan nan 0.42857142857142855 0.03571428571428571 nan nan
245 vanilla 41 43 nan nan 0.39285714285714285 0.07142857142857142 nan nan
246 vanilla 41 44 nan nan 0.17857142857142858 0.25 nan nan
247 vanilla 41 45 nan nan 0.21428571428571427 0.25 nan nan
248 vanilla 41 46 nan nan 0.07142857142857142 0.5357142857142857 nan nan
249 vanilla 41 47 nan nan 0.17857142857142858 0.5357142857142857 nan nan
250 vanilla 41 48 nan nan 0.10714285714285714 0.17857142857142858 nan nan
251 vanilla 41 49 nan nan 0.0 0.8214285714285714 nan nan
252 vanilla 41 50 0.56 nan 0.31 nan 0.17857142857142858 0.42857142857142855 nan nan
253 vanilla 41 51 nan nan 0.10714285714285714 0.5714285714285714 nan nan
254 vanilla 41 52 nan nan 0.10714285714285714 0.2857142857142857 nan nan
255 vanilla 41 53 nan nan 0.42857142857142855 0.0 nan nan
256 vanilla 41 54 nan nan 0.0 0.5357142857142857 nan nan
257 vanilla 41 55 nan nan 0.03571428571428571 0.6428571428571429 nan nan
258 vanilla 41 56 nan nan 0.39285714285714285 0.25 nan nan
259 vanilla 41 57 nan nan 0.2857142857142857 0.4642857142857143 nan nan
260 vanilla 41 58 nan nan 0.2857142857142857 0.21428571428571427 nan nan
261 vanilla 41 59 nan nan 0.2857142857142857 0.39285714285714285 nan nan
262 vanilla 41 60 0.47 0.25 0.53 0.55 0.6785714285714286 0.07142857142857142 0.25 0.55
263 vanilla 41 61 nan nan 0.32142857142857145 0.42857142857142855 nan nan
264 vanilla 41 62 nan nan 0.21428571428571427 0.5357142857142857 nan nan
265 vanilla 41 63 nan nan 0.17857142857142858 0.42857142857142855 nan nan
266 vanilla 41 64 nan nan 0.39285714285714285 0.21428571428571427 nan nan
267 vanilla 41 65 nan nan 0.07142857142857142 0.35714285714285715 nan nan
268 vanilla 41 66 nan nan 0.32142857142857145 0.25 nan nan
269 vanilla 41 67 nan nan 0.5714285714285714 0.2857142857142857 nan nan
270 vanilla 41 68 nan nan 0.6785714285714286 0.07142857142857142 nan nan
271 vanilla 41 69 nan nan 0.4642857142857143 0.25 nan nan
272 vanilla 41 70 0.56 nan 0.42 nan 0.39285714285714285 0.25 nan nan
273 vanilla 41 71 nan nan 0.39285714285714285 0.25 nan nan
274 vanilla 41 72 nan nan 0.25 0.42857142857142855 nan nan
275 vanilla 41 73 nan nan 0.32142857142857145 0.14285714285714285 nan nan
276 vanilla 41 74 nan nan 0.5714285714285714 0.07142857142857142 nan nan
277 vanilla 41 75 nan nan 0.0 0.8928571428571429 nan nan
278 vanilla 41 76 nan nan 0.25 0.03571428571428571 nan nan
279 vanilla 41 77 nan nan 0.2857142857142857 0.42857142857142855 nan nan
280 vanilla 41 78 nan nan 0.6785714285714286 0.03571428571428571 nan nan
281 vanilla 41 79 nan nan 0.32142857142857145 0.32142857142857145 nan nan
282 vanilla 41 80 0.67 0.22 0.22 0.5 0.39285714285714285 0.25 0.22 0.5
283 vanilla 41 81 nan nan 0.14285714285714285 0.4642857142857143 nan nan
284 vanilla 41 82 nan nan 0.7142857142857143 0.0 nan nan
285 vanilla 41 83 nan nan 0.42857142857142855 0.32142857142857145 nan nan
286 vanilla 41 84 nan nan 0.03571428571428571 0.7142857142857143 nan nan
287 vanilla 41 85 nan nan 0.39285714285714285 0.10714285714285714 nan nan
288 vanilla 41 86 nan nan 0.5357142857142857 0.17857142857142858 nan nan
289 vanilla 41 87 nan nan 0.07142857142857142 0.5 nan nan
290 vanilla 41 88 nan nan 0.10714285714285714 0.4642857142857143 nan nan
291 vanilla 41 89 nan nan 0.35714285714285715 0.42857142857142855 nan nan
292 vanilla 41 90 0.06 nan 0.0 nan 0.17857142857142858 0.5357142857142857 nan nan
293 vanilla 41 91 nan nan 0.32142857142857145 0.6428571428571429 nan nan
294 vanilla 41 92 nan nan 0.35714285714285715 0.5357142857142857 nan nan
295 vanilla 41 93 nan nan 0.03571428571428571 0.39285714285714285 nan nan
296 vanilla 41 94 nan nan 0.5 0.25 nan nan
297 vanilla 41 95 nan nan 0.2857142857142857 0.17857142857142858 nan nan
298 vanilla 41 96 nan nan 0.4642857142857143 0.25 nan nan
299 vanilla 41 97 nan nan 0.2857142857142857 0.2857142857142857 nan nan
300 vanilla 41 98 nan nan 0.39285714285714285 0.14285714285714285 nan nan
301 vanilla 41 99 nan nan 0.07142857142857142 0.5357142857142857 nan nan
302 vanilla 41 100 0.0 0.28 0.0 0.47 0.25 0.35714285714285715 0.28 0.47
303 vanilla 41 101 nan nan 0.10714285714285714 0.7142857142857143 nan nan
304 vanilla 41 102 nan nan 0.42857142857142855 0.35714285714285715 nan nan
305 vanilla 41 103 nan nan 0.7142857142857143 0.0 nan nan
306 vanilla 41 104 nan nan 0.35714285714285715 0.5 nan nan
307 vanilla 41 105 nan nan 0.35714285714285715 0.32142857142857145 nan nan
308 vanilla 41 106 nan nan 0.25 0.17857142857142858 nan nan
309 vanilla 41 107 nan nan 0.5 0.32142857142857145 nan nan
310 vanilla 41 108 nan nan 0.5 0.25 nan nan
311 vanilla 41 109 nan nan 0.7142857142857143 0.10714285714285714 nan nan
312 vanilla 41 110 0.0 nan 0.0 nan 0.39285714285714285 0.42857142857142855 nan nan
313 vanilla 41 111 nan nan 0.39285714285714285 0.39285714285714285 nan nan
314 vanilla 41 112 nan nan 0.21428571428571427 0.5 nan nan
315 vanilla 41 113 nan nan 0.5714285714285714 0.2857142857142857 nan nan
316 vanilla 41 114 nan nan 0.10714285714285714 0.5357142857142857 nan nan
317 vanilla 41 115 nan nan 0.32142857142857145 0.10714285714285714 nan nan
318 vanilla 41 116 nan nan 0.32142857142857145 0.21428571428571427 nan nan
319 vanilla 41 117 nan nan 0.5 0.25 nan nan
320 vanilla 41 118 nan nan 0.03571428571428571 0.32142857142857145 nan nan
321 vanilla 41 119 nan nan 0.14285714285714285 0.4642857142857143 nan nan
322 vanilla 41 120 0.0 0.33 0.0 0.41 0.5357142857142857 0.17857142857142858 0.33 0.41
323 vanilla 41 121 nan nan 0.5 0.35714285714285715 nan nan
324 vanilla 41 122 nan nan 0.2857142857142857 0.42857142857142855 nan nan
325 vanilla 41 123 nan nan 0.5714285714285714 0.03571428571428571 nan nan
326 vanilla 41 124 nan nan 0.35714285714285715 0.4642857142857143 nan nan
327 vanilla 41 125 nan nan 0.5714285714285714 0.17857142857142858 nan nan
328 vanilla 41 126 nan nan 0.35714285714285715 0.25 nan nan
329 vanilla 41 127 nan nan 0.25 0.42857142857142855 nan nan
330 vanilla 41 128 nan nan 0.17857142857142858 0.39285714285714285 nan nan
331 vanilla 41 129 nan nan 0.39285714285714285 0.21428571428571427 nan nan
332 vanilla 41 130 0.03 nan 0.0 nan 0.42857142857142855 0.25 nan nan
333 vanilla 41 131 nan nan 0.2857142857142857 0.5 nan nan
334 vanilla 41 132 nan nan 0.03571428571428571 0.5357142857142857 nan nan
335 vanilla 41 133 nan nan 0.39285714285714285 0.5 nan nan
336 vanilla 41 134 nan nan 0.17857142857142858 0.5357142857142857 nan nan
337 vanilla 41 135 nan nan 0.42857142857142855 0.2857142857142857 nan nan
338 vanilla 41 136 nan nan 0.32142857142857145 0.35714285714285715 nan nan
339 vanilla 41 137 nan nan 0.42857142857142855 0.39285714285714285 nan nan
340 vanilla 41 138 nan nan 0.32142857142857145 0.39285714285714285 nan nan
341 vanilla 41 139 nan nan 0.32142857142857145 0.4642857142857143 nan nan
342 vanilla 41 140 0.28 0.45 0.25 0.03571428571428571 0.28 0.45
343 vanilla 41 141 nan nan 0.4642857142857143 0.10714285714285714 nan nan
344 vanilla 41 142 nan nan 0.6785714285714286 0.21428571428571427 nan nan
345 vanilla 41 143 nan nan 0.5357142857142857 0.21428571428571427 nan nan
346 vanilla 41 144 nan nan 0.4642857142857143 0.4642857142857143 nan nan
347 vanilla 41 145 nan nan 0.39285714285714285 0.14285714285714285 nan nan
348 vanilla 41 146 nan nan 0.42857142857142855 0.35714285714285715 nan nan
349 vanilla 41 147 nan nan 0.03571428571428571 0.35714285714285715 nan nan
350 vanilla 41 148 nan nan 0.42857142857142855 0.35714285714285715 nan nan
351 vanilla 41 149 nan nan 0.32142857142857145 0.39285714285714285 nan nan
352 vanilla 41 150 nan nan 0.5357142857142857 0.25 nan nan
353 vanilla 41 151 nan nan 0.21428571428571427 0.42857142857142855 nan nan
354 vanilla 41 152 nan nan 0.39285714285714285 0.4642857142857143 nan nan
355 vanilla 41 153 nan nan 0.42857142857142855 0.35714285714285715 nan nan
356 vanilla 41 154 nan nan 0.17857142857142858 0.4642857142857143 nan nan
357 vanilla 41 155 nan nan 0.5 0.21428571428571427 nan nan
358 vanilla 41 156 nan nan 0.03571428571428571 0.5357142857142857 nan nan
359 vanilla 41 157 nan nan 0.6785714285714286 0.17857142857142858 nan nan
360 vanilla 41 158 nan nan 0.5357142857142857 0.21428571428571427 nan nan
361 vanilla 41 159 nan nan 0.03571428571428571 0.42857142857142855 nan nan
362 vanilla 41 160 0.33 0.44 0.17857142857142858 0.75 0.33 0.44
363 vanilla 41 161 nan nan 0.6428571428571429 0.21428571428571427 nan nan
364 vanilla 41 162 nan nan 0.5357142857142857 0.25 nan nan
365 vanilla 41 163 nan nan 0.5714285714285714 0.10714285714285714 nan nan
366 vanilla 41 164 nan nan 0.17857142857142858 0.6785714285714286 nan nan
367 vanilla 41 165 nan nan 0.4642857142857143 0.39285714285714285 nan nan
368 vanilla 41 166 nan nan 0.5714285714285714 0.14285714285714285 nan nan
369 vanilla 41 167 nan nan 0.4642857142857143 0.25 nan nan
370 vanilla 41 168 nan nan 0.35714285714285715 0.14285714285714285 nan nan
371 vanilla 41 169 nan nan 0.5 0.32142857142857145 nan nan
372 vanilla 41 170 nan nan 0.6785714285714286 0.17857142857142858 nan nan
373 vanilla 41 171 nan nan 0.6428571428571429 0.07142857142857142 nan nan
374 vanilla 41 172 nan nan 0.35714285714285715 0.32142857142857145 nan nan
375 vanilla 41 173 nan nan 0.5357142857142857 0.25 nan nan
376 vanilla 41 174 nan nan 0.6428571428571429 0.14285714285714285 nan nan
377 vanilla 41 175 nan nan 0.32142857142857145 0.42857142857142855 nan nan
378 vanilla 41 176 nan nan 0.42857142857142855 0.39285714285714285 nan nan
379 vanilla 41 177 nan nan 0.25 0.35714285714285715 nan nan
380 vanilla 41 178 nan nan 0.4642857142857143 0.14285714285714285 nan nan
381 vanilla 41 179 nan nan 0.6785714285714286 0.25 nan nan
382 vanilla 41 180 0.39 0.5 0.17857142857142858 0.39285714285714285 0.39 0.5
383 vanilla 41 181 nan nan 0.42857142857142855 0.14285714285714285 nan nan
384 vanilla 41 182 nan nan 0.03571428571428571 0.5357142857142857 nan nan
385 vanilla 41 183 nan nan 0.2857142857142857 0.39285714285714285 nan nan
386 vanilla 41 184 nan nan 0.4642857142857143 0.14285714285714285 nan nan
387 vanilla 41 185 nan nan 0.4642857142857143 0.17857142857142858 nan nan
388 vanilla 41 186 nan nan 0.14285714285714285 0.14285714285714285 nan nan
389 vanilla 41 187 nan nan 0.6071428571428571 0.0 nan nan
390 vanilla 41 188 nan nan 0.9285714285714286 0.03571428571428571 nan nan
391 vanilla 41 189 nan nan 0.07142857142857142 0.6785714285714286 nan nan
392 vanilla 41 190 nan nan 0.6071428571428571 0.32142857142857145 nan nan
393 vanilla 41 191 nan nan 0.5 0.25 nan nan
394 vanilla 41 192 nan nan 0.5 0.25 nan nan
395 vanilla 41 193 nan nan 0.6785714285714286 0.2857142857142857 nan nan
396 vanilla 41 194 nan nan 0.5714285714285714 0.14285714285714285 nan nan
397 vanilla 41 195 nan nan 0.17857142857142858 0.07142857142857142 nan nan
398 vanilla 41 196 nan nan 0.6785714285714286 0.17857142857142858 nan nan
399 vanilla 41 197 nan nan 0.42857142857142855 0.35714285714285715 nan nan
400 vanilla 41 198 nan nan 0.14285714285714285 0.5357142857142857 nan nan
401 vanilla 41 199 0.34 0.5 0.14285714285714285 0.4642857142857143 0.34 0.5