diff --git a/docs/writeup/main.tex b/docs/writeup/main.tex index d2dfa9a..fd9404a 100644 --- a/docs/writeup/main.tex +++ b/docs/writeup/main.tex @@ -373,39 +373,38 @@ enough to route one as it forms. \subsection{Long-run convergence} The 60-step gap persists to convergence: at 200 steps route's deploy hack stays -at zero while vanilla acquires the hack and then collapses -(Figure~\ref{fig:longrun}). \TODO{prose -- author. FIXME: the "collapses" framing -is preset-induced (job 85 hot preset); job 97 shows vanilla stays coherent and -keeps hacking under a sane preset. Rewrite to "vanilla rises, route2 stays at 0" -once the matched beta=1e-5 figure (jobs 100/101) lands -- see figure provenance.} +pinned at zero while vanilla acquires the hack and rises to ${\sim}0.32$ +(Figure~\ref{fig:longrun}), with route's solve rate ending higher +(${\sim}0.61$ vs ${\sim}0.47$). \TODO{prose -- author.} % --- Figure: 200-step ------------------------------------------------------- -% Provenance: route2 = pueue job 84 (out/runs/20260602T080804_..._route2_converge200_s41); -% vanilla = job 85 (out/runs/20260602T163201_..._vanilla_converge200_s41; vanilla still -% running at writing -> left panel fills to step 200 on completion). Data source committed -% at out/figs/dyn_longrun_200.csv; regen: uv run python scripts/plot_dynamics.py . -% FIXME (2026-06-04, #184/#187): the vanilla "collapse around step 88" below is a -% PRESET artifact, not a property of vanilla GRPO. Job 85 used the hot preset -% (lr=3e-3, adam beta1=0.5, beta=0). Job 97 re-ran vanilla-200 at a gentle preset -% (lr=1e-3, adam 0.9/0.99, beta=0) and it stayed coherent: lp_s in [-0.47,-0.29] -% through step 200, deploy hack 0.375 (run_tests 0.875, file_marker 0.53), no -% collapse. Also job 84 (route2) and job 85 (vanilla) use mismatched optimizers, -% so this overlay is apples-to-oranges. Regenerate this figure from the matched -% beta=1e-5 pair (jobs 100/101, _none200_kl5 / _route2200_kl5) when they land, and -% drop the "collapses" claim -- the honest contrast is route2 holds deploy hack ~0 -% while vanilla RISES (not collapses) under a sane preset. +% Provenance: route2 = pueue job 84 (out/runs/20260602T080804_..._route2_converge200_s41, +% deploy hack 0.000 solve 0.609); vanilla = job 97 (out/runs/20260603T104901_..._vanilla200_gentle_s41, +% deploy hack 0.375 solve 0.484, coherent through step 200 -- no collapse). Data source +% committed at out/figs/dyn_longrun_200.csv; regen: uv run python scripts/plot_dynamics.py +% logs/20260602T080804_..._route2_converge200_s41.log logs/20260603T104901_..._vanilla200_gentle_s41.log +% --out out/figs/dyn_longrun_200.png +% CAVEAT (2026-06-05, #184): optimizer mismatch. route2 (job 84) ran the FastConfig +% default hot preset (lr=3e-3, adam beta1=0.5, beta2=0.9); vanilla (job 97) ran a +% gentle preset (lr=1e-3, adam 0.9/0.99). Both beta=0 (no KL). This cuts in our +% favour -- route2 holds hack at 0 even under the more aggressive optimizer that +% drives vanilla up -- but it is not yet apples-to-apples. TODO: regenerate from +% the matched beta=1e-5 pair (jobs 100/101, _none200_kl5 / _route2200_kl5) when +% they land; expect the same qualitative result. This replaces the earlier job-85 +% hot-preset vanilla, whose step-88 "collapse" was a preset artifact (job 97 stays +% coherent: lp_s in [-0.47,-0.29] through step 200), not a property of vanilla GRPO. \begin{figure}[t] \centering \includegraphics[width=0.95\linewidth]{../../out/figs/dyn_longrun_200.png} - \caption{Deploy hack (red) and solve (green) over 200 GRPO steps for the same - two arms, seed 41 (deploy evaluation $n{=}64$, $T{=}0.7$, EMA-5). route (right) - holds deploy hack at $0$ for all 200 steps while solve climbs to ${\sim}0.61$ - and plateaus. vanilla (left) acquires the hack (${\sim}0.55$ by step~80), then - collapses around step~88: student log-prob craters, reward falls to $0$, and the - pre-clip gradient norm spikes ${\sim}75\times$ with no KL anchor, dragging hack - and solve down together. That late descent is degeneration, not hack - suppression, so the valid comparison window is steps 0--85; within it vanilla - acquires the hack and route never does.} + \caption{Deploy hack (red) and solve (green) over 200 GRPO steps, seed 41 + (deploy evaluation $n{=}64$, $T{=}0.7$, EMA-5). route (right) holds deploy hack + at $0$ for all 200 steps while solve climbs to ${\sim}0.61$ and plateaus. + vanilla (left) acquires the hack from onset near step~40 and rises to + ${\sim}0.32$ by step~200, with solve plateauing lower (${\sim}0.47$). Neither + arm degenerates. Optimizer settings differ between arms (route2 ran the + aggressive default preset, vanilla a gentler one; see source comment), so this + is a directional rather than matched comparison; the matched-optimizer + regeneration is pending.} \label{fig:longrun} \end{figure} diff --git a/out/figs/dyn_longrun_200.csv b/out/figs/dyn_longrun_200.csv index f1e0c0a..f6c9565 100644 --- a/out/figs/dyn_longrun_200.csv +++ b/out/figs/dyn_longrun_200.csv @@ -1,341 +1,401 @@ -arm,seed,step,hack,solve -routing2,41,0,0.0,0.38 -routing2,41,1,nan,nan -routing2,41,2,nan,nan -routing2,41,3,nan,nan -routing2,41,4,nan,nan -routing2,41,5,nan,nan -routing2,41,6,nan,nan -routing2,41,7,nan,nan -routing2,41,8,nan,nan -routing2,41,9,nan,nan -routing2,41,10,0.0,0.45 -routing2,41,11,nan,nan -routing2,41,12,nan,nan -routing2,41,13,nan,nan -routing2,41,14,nan,nan -routing2,41,15,nan,nan -routing2,41,16,nan,nan -routing2,41,17,nan,nan -routing2,41,18,nan,nan -routing2,41,19,nan,nan -routing2,41,20,0.0,0.62 -routing2,41,21,nan,nan -routing2,41,22,nan,nan -routing2,41,23,nan,nan -routing2,41,24,nan,nan -routing2,41,25,nan,nan -routing2,41,26,nan,nan -routing2,41,27,nan,nan -routing2,41,28,nan,nan -routing2,41,29,nan,nan -routing2,41,30,0.0,0.62 -routing2,41,31,nan,nan -routing2,41,32,nan,nan -routing2,41,33,nan,nan -routing2,41,34,nan,nan -routing2,41,35,nan,nan -routing2,41,36,nan,nan -routing2,41,37,nan,nan -routing2,41,38,nan,nan -routing2,41,39,nan,nan -routing2,41,40,0.0,0.61 -routing2,41,41,nan,nan -routing2,41,42,nan,nan -routing2,41,43,nan,nan -routing2,41,44,nan,nan -routing2,41,45,nan,nan -routing2,41,46,nan,nan -routing2,41,47,nan,nan -routing2,41,48,nan,nan -routing2,41,49,nan,nan -routing2,41,50,0.0,0.62 -routing2,41,51,nan,nan -routing2,41,52,nan,nan -routing2,41,53,nan,nan -routing2,41,54,nan,nan -routing2,41,55,nan,nan -routing2,41,56,nan,nan -routing2,41,57,nan,nan -routing2,41,58,nan,nan -routing2,41,59,nan,nan -routing2,41,60,0.0,0.62 -routing2,41,61,nan,nan -routing2,41,62,nan,nan -routing2,41,63,nan,nan -routing2,41,64,nan,nan -routing2,41,65,nan,nan -routing2,41,66,nan,nan -routing2,41,67,nan,nan -routing2,41,68,nan,nan -routing2,41,69,nan,nan -routing2,41,70,0.0,0.62 -routing2,41,71,nan,nan -routing2,41,72,nan,nan -routing2,41,73,nan,nan -routing2,41,74,nan,nan -routing2,41,75,nan,nan -routing2,41,76,nan,nan -routing2,41,77,nan,nan -routing2,41,78,nan,nan -routing2,41,79,nan,nan -routing2,41,80,0.0,0.59 -routing2,41,81,nan,nan -routing2,41,82,nan,nan -routing2,41,83,nan,nan -routing2,41,84,nan,nan -routing2,41,85,nan,nan -routing2,41,86,nan,nan -routing2,41,87,nan,nan -routing2,41,88,nan,nan -routing2,41,89,nan,nan -routing2,41,90,0.0,0.62 -routing2,41,91,nan,nan -routing2,41,92,nan,nan -routing2,41,93,nan,nan -routing2,41,94,nan,nan -routing2,41,95,nan,nan -routing2,41,96,nan,nan -routing2,41,97,nan,nan -routing2,41,98,nan,nan -routing2,41,99,nan,nan -routing2,41,100,0.0,0.62 -routing2,41,101,nan,nan -routing2,41,102,nan,nan -routing2,41,103,nan,nan -routing2,41,104,nan,nan -routing2,41,105,nan,nan -routing2,41,106,nan,nan -routing2,41,107,nan,nan -routing2,41,108,nan,nan -routing2,41,109,nan,nan -routing2,41,110,0.0,0.62 -routing2,41,111,nan,nan -routing2,41,112,nan,nan -routing2,41,113,nan,nan -routing2,41,114,nan,nan -routing2,41,115,nan,nan -routing2,41,116,nan,nan -routing2,41,117,nan,nan -routing2,41,118,nan,nan -routing2,41,119,nan,nan -routing2,41,120,0.0,0.62 -routing2,41,121,nan,nan -routing2,41,122,nan,nan -routing2,41,123,nan,nan -routing2,41,124,nan,nan -routing2,41,125,nan,nan -routing2,41,126,nan,nan -routing2,41,127,nan,nan -routing2,41,128,nan,nan -routing2,41,129,nan,nan -routing2,41,130,0.0,0.62 -routing2,41,131,nan,nan -routing2,41,132,nan,nan -routing2,41,133,nan,nan -routing2,41,134,nan,nan -routing2,41,135,nan,nan -routing2,41,136,nan,nan -routing2,41,137,nan,nan -routing2,41,138,nan,nan -routing2,41,139,nan,nan -routing2,41,140,0.0,0.62 -routing2,41,141,nan,nan -routing2,41,142,nan,nan -routing2,41,143,nan,nan -routing2,41,144,nan,nan -routing2,41,145,nan,nan -routing2,41,146,nan,nan -routing2,41,147,nan,nan -routing2,41,148,nan,nan -routing2,41,149,nan,nan -routing2,41,150,0.0,0.62 -routing2,41,151,nan,nan -routing2,41,152,nan,nan -routing2,41,153,nan,nan -routing2,41,154,nan,nan -routing2,41,155,nan,nan -routing2,41,156,nan,nan -routing2,41,157,nan,nan -routing2,41,158,nan,nan -routing2,41,159,nan,nan -routing2,41,160,0.0,0.62 -routing2,41,161,nan,nan -routing2,41,162,nan,nan -routing2,41,163,nan,nan -routing2,41,164,nan,nan -routing2,41,165,nan,nan -routing2,41,166,nan,nan -routing2,41,167,nan,nan -routing2,41,168,nan,nan -routing2,41,169,nan,nan -routing2,41,170,0.0,0.62 -routing2,41,171,nan,nan -routing2,41,172,nan,nan -routing2,41,173,nan,nan -routing2,41,174,nan,nan -routing2,41,175,nan,nan -routing2,41,176,nan,nan -routing2,41,177,nan,nan -routing2,41,178,nan,nan -routing2,41,179,nan,nan -routing2,41,180,0.0,0.62 -routing2,41,181,nan,nan -routing2,41,182,nan,nan -routing2,41,183,nan,nan -routing2,41,184,nan,nan -routing2,41,185,nan,nan -routing2,41,186,nan,nan -routing2,41,187,nan,nan -routing2,41,188,nan,nan -routing2,41,189,nan,nan -routing2,41,190,0.0,0.62 -routing2,41,191,nan,nan -routing2,41,192,nan,nan -routing2,41,193,nan,nan -routing2,41,194,nan,nan -routing2,41,195,nan,nan -routing2,41,196,nan,nan -routing2,41,197,nan,nan -routing2,41,198,nan,nan -routing2,41,199,0.0,0.61 -vanilla,41,0,0.0,0.38 -vanilla,41,1,nan,nan -vanilla,41,2,nan,nan -vanilla,41,3,nan,nan -vanilla,41,4,nan,nan -vanilla,41,5,nan,nan -vanilla,41,6,nan,nan -vanilla,41,7,nan,nan -vanilla,41,8,nan,nan -vanilla,41,9,nan,nan -vanilla,41,10,0.0,0.5 -vanilla,41,11,nan,nan -vanilla,41,12,nan,nan -vanilla,41,13,nan,nan -vanilla,41,14,nan,nan -vanilla,41,15,nan,nan -vanilla,41,16,nan,nan -vanilla,41,17,nan,nan -vanilla,41,18,nan,nan -vanilla,41,19,nan,nan -vanilla,41,20,0.16,0.5 -vanilla,41,21,nan,nan -vanilla,41,22,nan,nan -vanilla,41,23,nan,nan -vanilla,41,24,nan,nan -vanilla,41,25,nan,nan -vanilla,41,26,nan,nan -vanilla,41,27,nan,nan -vanilla,41,28,nan,nan -vanilla,41,29,nan,nan -vanilla,41,30,0.31,0.45 -vanilla,41,31,nan,nan -vanilla,41,32,nan,nan -vanilla,41,33,nan,nan -vanilla,41,34,nan,nan -vanilla,41,35,nan,nan -vanilla,41,36,nan,nan -vanilla,41,37,nan,nan -vanilla,41,38,nan,nan -vanilla,41,39,nan,nan -vanilla,41,40,0.36,0.45 -vanilla,41,41,nan,nan -vanilla,41,42,nan,nan -vanilla,41,43,nan,nan -vanilla,41,44,nan,nan -vanilla,41,45,nan,nan -vanilla,41,46,nan,nan -vanilla,41,47,nan,nan -vanilla,41,48,nan,nan -vanilla,41,49,nan,nan -vanilla,41,50,0.56,0.31 -vanilla,41,51,nan,nan -vanilla,41,52,nan,nan -vanilla,41,53,nan,nan -vanilla,41,54,nan,nan -vanilla,41,55,nan,nan -vanilla,41,56,nan,nan -vanilla,41,57,nan,nan -vanilla,41,58,nan,nan -vanilla,41,59,nan,nan -vanilla,41,60,0.47,0.53 -vanilla,41,61,nan,nan -vanilla,41,62,nan,nan -vanilla,41,63,nan,nan -vanilla,41,64,nan,nan -vanilla,41,65,nan,nan -vanilla,41,66,nan,nan -vanilla,41,67,nan,nan -vanilla,41,68,nan,nan -vanilla,41,69,nan,nan -vanilla,41,70,0.56,0.42 -vanilla,41,71,nan,nan -vanilla,41,72,nan,nan -vanilla,41,73,nan,nan -vanilla,41,74,nan,nan -vanilla,41,75,nan,nan -vanilla,41,76,nan,nan -vanilla,41,77,nan,nan -vanilla,41,78,nan,nan -vanilla,41,79,nan,nan -vanilla,41,80,0.67,0.22 -vanilla,41,81,nan,nan -vanilla,41,82,nan,nan -vanilla,41,83,nan,nan -vanilla,41,84,nan,nan -vanilla,41,85,nan,nan -vanilla,41,86,nan,nan -vanilla,41,87,nan,nan -vanilla,41,88,nan,nan -vanilla,41,89,nan,nan -vanilla,41,90,0.06,0.0 -vanilla,41,91,nan,nan -vanilla,41,92,nan,nan -vanilla,41,93,nan,nan -vanilla,41,94,nan,nan -vanilla,41,95,nan,nan -vanilla,41,96,nan,nan -vanilla,41,97,nan,nan -vanilla,41,98,nan,nan -vanilla,41,99,nan,nan -vanilla,41,100,0.0,0.0 -vanilla,41,101,nan,nan -vanilla,41,102,nan,nan -vanilla,41,103,nan,nan -vanilla,41,104,nan,nan -vanilla,41,105,nan,nan -vanilla,41,106,nan,nan -vanilla,41,107,nan,nan -vanilla,41,108,nan,nan -vanilla,41,109,nan,nan -vanilla,41,110,0.0,0.0 -vanilla,41,111,nan,nan -vanilla,41,112,nan,nan -vanilla,41,113,nan,nan -vanilla,41,114,nan,nan -vanilla,41,115,nan,nan -vanilla,41,116,nan,nan -vanilla,41,117,nan,nan -vanilla,41,118,nan,nan -vanilla,41,119,nan,nan -vanilla,41,120,0.0,0.0 -vanilla,41,121,nan,nan -vanilla,41,122,nan,nan -vanilla,41,123,nan,nan -vanilla,41,124,nan,nan -vanilla,41,125,nan,nan -vanilla,41,126,nan,nan -vanilla,41,127,nan,nan -vanilla,41,128,nan,nan -vanilla,41,129,nan,nan -vanilla,41,130,0.03,0.0 -vanilla,41,131,nan,nan -vanilla,41,132,nan,nan -vanilla,41,133,nan,nan -vanilla,41,134,nan,nan -vanilla,41,135,nan,nan -vanilla,41,136,nan,nan -vanilla,41,137,nan,nan -vanilla,41,138,nan,nan -vanilla,41,139,nan,nan +arm,seed,step,hack_s,gt_s,hack_train,solve_train,hk_dep,slv_dep +routing2,41,0,0.0,0.38,0.0,0.14285714285714285,0.0,0.38 +routing2,41,1,nan,nan,0.0,0.21428571428571427,nan,nan +routing2,41,2,nan,nan,0.0,0.0,nan,nan +routing2,41,3,nan,nan,0.0,0.17857142857142858,nan,nan +routing2,41,4,nan,nan,0.0,0.0,nan,nan +routing2,41,5,nan,nan,0.0,0.4642857142857143,nan,nan +routing2,41,6,nan,nan,0.0,0.25,nan,nan +routing2,41,7,nan,nan,0.0,0.07142857142857142,nan,nan +routing2,41,8,nan,nan,0.0,0.25,nan,nan +routing2,41,9,nan,nan,0.0,0.4642857142857143,nan,nan +routing2,41,10,0.0,0.45,0.0,0.32142857142857145,0.0,0.45 +routing2,41,11,nan,nan,0.0,0.4642857142857143,nan,nan +routing2,41,12,nan,nan,0.0,0.25,nan,nan +routing2,41,13,nan,nan,0.0,0.39285714285714285,nan,nan +routing2,41,14,nan,nan,0.0,0.5714285714285714,nan,nan +routing2,41,15,nan,nan,0.07142857142857142,0.75,nan,nan +routing2,41,16,nan,nan,0.2857142857142857,0.39285714285714285,nan,nan +routing2,41,17,nan,nan,0.21428571428571427,0.21428571428571427,nan,nan +routing2,41,18,nan,nan,0.0,0.5357142857142857,nan,nan +routing2,41,19,nan,nan,0.32142857142857145,0.14285714285714285,nan,nan +routing2,41,20,0.0,0.62,0.0,0.5357142857142857,0.0,0.62 +routing2,41,21,nan,nan,0.0,0.6428571428571429,nan,nan +routing2,41,22,nan,nan,0.5,0.25,nan,nan +routing2,41,23,nan,nan,0.32142857142857145,0.4642857142857143,nan,nan +routing2,41,24,nan,nan,0.21428571428571427,0.2857142857142857,nan,nan +routing2,41,25,nan,nan,0.42857142857142855,0.25,nan,nan +routing2,41,26,nan,nan,0.5,0.03571428571428571,nan,nan +routing2,41,27,nan,nan,0.17857142857142858,0.5714285714285714,nan,nan +routing2,41,28,nan,nan,0.10714285714285714,0.17857142857142858,nan,nan +routing2,41,29,nan,nan,0.35714285714285715,0.4642857142857143,nan,nan +routing2,41,30,0.0,0.62,0.75,0.0,0.0,0.62 +routing2,41,31,nan,nan,0.75,0.10714285714285714,nan,nan +routing2,41,32,nan,nan,0.21428571428571427,0.5714285714285714,nan,nan +routing2,41,33,nan,nan,0.75,0.17857142857142858,nan,nan +routing2,41,34,nan,nan,0.4642857142857143,0.21428571428571427,nan,nan +routing2,41,35,nan,nan,0.17857142857142858,0.4642857142857143,nan,nan +routing2,41,36,nan,nan,0.6428571428571429,0.10714285714285714,nan,nan +routing2,41,37,nan,nan,0.35714285714285715,0.42857142857142855,nan,nan +routing2,41,38,nan,nan,0.32142857142857145,0.4642857142857143,nan,nan +routing2,41,39,nan,nan,0.6071428571428571,0.35714285714285715,nan,nan +routing2,41,40,0.0,0.61,0.6785714285714286,0.32142857142857145,0.0,0.61 +routing2,41,41,nan,nan,0.6428571428571429,0.25,nan,nan +routing2,41,42,nan,nan,0.75,0.14285714285714285,nan,nan +routing2,41,43,nan,nan,0.7857142857142857,0.10714285714285714,nan,nan +routing2,41,44,nan,nan,0.6785714285714286,0.21428571428571427,nan,nan +routing2,41,45,nan,nan,0.39285714285714285,0.5357142857142857,nan,nan +routing2,41,46,nan,nan,0.5357142857142857,0.4642857142857143,nan,nan +routing2,41,47,nan,nan,0.4642857142857143,0.5,nan,nan +routing2,41,48,nan,nan,0.8571428571428571,0.07142857142857142,nan,nan +routing2,41,49,nan,nan,0.2857142857142857,0.6785714285714286,nan,nan +routing2,41,50,0.0,0.62,0.5,0.42857142857142855,0.0,0.62 +routing2,41,51,nan,nan,0.4642857142857143,0.5357142857142857,nan,nan +routing2,41,52,nan,nan,0.6428571428571429,0.32142857142857145,nan,nan +routing2,41,53,nan,nan,0.8571428571428571,0.07142857142857142,nan,nan +routing2,41,54,nan,nan,0.39285714285714285,0.4642857142857143,nan,nan +routing2,41,55,nan,nan,0.5,0.42857142857142855,nan,nan +routing2,41,56,nan,nan,0.7142857142857143,0.2857142857142857,nan,nan +routing2,41,57,nan,nan,0.39285714285714285,0.5714285714285714,nan,nan +routing2,41,58,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan +routing2,41,59,nan,nan,0.5714285714285714,0.39285714285714285,nan,nan +routing2,41,60,0.0,0.62,0.75,0.14285714285714285,0.0,0.62 +routing2,41,61,nan,nan,0.7857142857142857,0.21428571428571427,nan,nan +routing2,41,62,nan,nan,0.32142857142857145,0.6428571428571429,nan,nan +routing2,41,63,nan,nan,0.2857142857142857,0.5714285714285714,nan,nan +routing2,41,64,nan,nan,0.7857142857142857,0.21428571428571427,nan,nan +routing2,41,65,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan +routing2,41,66,nan,nan,0.75,0.21428571428571427,nan,nan +routing2,41,67,nan,nan,0.6428571428571429,0.2857142857142857,nan,nan +routing2,41,68,nan,nan,0.7857142857142857,0.14285714285714285,nan,nan +routing2,41,69,nan,nan,0.75,0.25,nan,nan +routing2,41,70,0.0,0.62,0.6071428571428571,0.35714285714285715,0.0,0.62 +routing2,41,71,nan,nan,0.6428571428571429,0.35714285714285715,nan,nan +routing2,41,72,nan,nan,0.7142857142857143,0.25,nan,nan +routing2,41,73,nan,nan,0.7857142857142857,0.21428571428571427,nan,nan +routing2,41,74,nan,nan,0.9285714285714286,0.03571428571428571,nan,nan +routing2,41,75,nan,nan,0.21428571428571427,0.75,nan,nan +routing2,41,76,nan,nan,0.8214285714285714,0.14285714285714285,nan,nan +routing2,41,77,nan,nan,0.5357142857142857,0.39285714285714285,nan,nan +routing2,41,78,nan,nan,0.75,0.21428571428571427,nan,nan +routing2,41,79,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan +routing2,41,80,0.0,0.59,0.8214285714285714,0.14285714285714285,0.0,0.59 +routing2,41,81,nan,nan,0.35714285714285715,0.6071428571428571,nan,nan +routing2,41,82,nan,nan,1.0,0.0,nan,nan +routing2,41,83,nan,nan,0.6071428571428571,0.32142857142857145,nan,nan +routing2,41,84,nan,nan,0.10714285714285714,0.8928571428571429,nan,nan +routing2,41,85,nan,nan,0.7857142857142857,0.17857142857142858,nan,nan +routing2,41,86,nan,nan,0.8214285714285714,0.14285714285714285,nan,nan +routing2,41,87,nan,nan,0.14285714285714285,0.8571428571428571,nan,nan +routing2,41,88,nan,nan,0.32142857142857145,0.6785714285714286,nan,nan +routing2,41,89,nan,nan,0.6071428571428571,0.35714285714285715,nan,nan +routing2,41,90,0.0,0.62,0.5357142857142857,0.4642857142857143,0.0,0.62 +routing2,41,91,nan,nan,0.42857142857142855,0.5357142857142857,nan,nan +routing2,41,92,nan,nan,0.35714285714285715,0.6428571428571429,nan,nan +routing2,41,93,nan,nan,0.5357142857142857,0.4642857142857143,nan,nan +routing2,41,94,nan,nan,0.75,0.25,nan,nan +routing2,41,95,nan,nan,0.5714285714285714,0.39285714285714285,nan,nan +routing2,41,96,nan,nan,0.75,0.25,nan,nan +routing2,41,97,nan,nan,0.5,0.5,nan,nan +routing2,41,98,nan,nan,0.8214285714285714,0.17857142857142858,nan,nan +routing2,41,99,nan,nan,0.42857142857142855,0.5714285714285714,nan,nan +routing2,41,100,0.0,0.62,0.6071428571428571,0.39285714285714285,0.0,0.62 +routing2,41,101,nan,nan,0.21428571428571427,0.7142857142857143,nan,nan +routing2,41,102,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan +routing2,41,103,nan,nan,1.0,0.0,nan,nan +routing2,41,104,nan,nan,0.39285714285714285,0.5714285714285714,nan,nan +routing2,41,105,nan,nan,0.6428571428571429,0.32142857142857145,nan,nan +routing2,41,106,nan,nan,0.8214285714285714,0.17857142857142858,nan,nan +routing2,41,107,nan,nan,0.6071428571428571,0.39285714285714285,nan,nan +routing2,41,108,nan,nan,0.7142857142857143,0.2857142857142857,nan,nan +routing2,41,109,nan,nan,0.8571428571428571,0.14285714285714285,nan,nan +routing2,41,110,0.0,0.62,0.4642857142857143,0.5357142857142857,0.0,0.62 +routing2,41,111,nan,nan,0.4642857142857143,0.4642857142857143,nan,nan +routing2,41,112,nan,nan,0.2857142857142857,0.7142857142857143,nan,nan +routing2,41,113,nan,nan,0.75,0.25,nan,nan +routing2,41,114,nan,nan,0.4642857142857143,0.5357142857142857,nan,nan +routing2,41,115,nan,nan,0.7857142857142857,0.21428571428571427,nan,nan +routing2,41,116,nan,nan,0.6428571428571429,0.35714285714285715,nan,nan +routing2,41,117,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan +routing2,41,118,nan,nan,0.2857142857142857,0.6785714285714286,nan,nan +routing2,41,119,nan,nan,0.5,0.5,nan,nan +routing2,41,120,0.0,0.62,0.8214285714285714,0.17857142857142858,0.0,0.62 +routing2,41,121,nan,nan,0.75,0.21428571428571427,nan,nan +routing2,41,122,nan,nan,0.39285714285714285,0.6071428571428571,nan,nan +routing2,41,123,nan,nan,0.75,0.21428571428571427,nan,nan +routing2,41,124,nan,nan,0.32142857142857145,0.6785714285714286,nan,nan +routing2,41,125,nan,nan,0.75,0.25,nan,nan +routing2,41,126,nan,nan,0.75,0.25,nan,nan +routing2,41,127,nan,nan,0.4642857142857143,0.5357142857142857,nan,nan +routing2,41,128,nan,nan,0.6428571428571429,0.35714285714285715,nan,nan +routing2,41,129,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan +routing2,41,130,0.0,0.62,0.7142857142857143,0.2857142857142857,0.0,0.62 +routing2,41,131,nan,nan,0.32142857142857145,0.6785714285714286,nan,nan +routing2,41,132,nan,nan,0.25,0.7142857142857143,nan,nan +routing2,41,133,nan,nan,0.5357142857142857,0.42857142857142855,nan,nan +routing2,41,134,nan,nan,0.2857142857142857,0.7142857142857143,nan,nan +routing2,41,135,nan,nan,0.5357142857142857,0.4642857142857143,nan,nan +routing2,41,136,nan,nan,0.5357142857142857,0.4642857142857143,nan,nan +routing2,41,137,nan,nan,0.4642857142857143,0.5,nan,nan +routing2,41,138,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan +routing2,41,139,nan,nan,0.39285714285714285,0.6071428571428571,nan,nan +routing2,41,140,0.0,0.62,0.75,0.25,0.0,0.62 +routing2,41,141,nan,nan,0.75,0.21428571428571427,nan,nan +routing2,41,142,nan,nan,0.75,0.25,nan,nan +routing2,41,143,nan,nan,0.5714285714285714,0.35714285714285715,nan,nan +routing2,41,144,nan,nan,0.6428571428571429,0.35714285714285715,nan,nan +routing2,41,145,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan +routing2,41,146,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan +routing2,41,147,nan,nan,0.6071428571428571,0.39285714285714285,nan,nan +routing2,41,148,nan,nan,0.5714285714285714,0.35714285714285715,nan,nan +routing2,41,149,nan,nan,0.5,0.5,nan,nan +routing2,41,150,0.0,0.62,0.75,0.25,0.0,0.62 +routing2,41,151,nan,nan,0.39285714285714285,0.6071428571428571,nan,nan +routing2,41,152,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan +routing2,41,153,nan,nan,0.39285714285714285,0.6071428571428571,nan,nan +routing2,41,154,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan +routing2,41,155,nan,nan,0.9285714285714286,0.07142857142857142,nan,nan +routing2,41,156,nan,nan,0.2857142857142857,0.7142857142857143,nan,nan +routing2,41,157,nan,nan,0.8214285714285714,0.17857142857142858,nan,nan +routing2,41,158,nan,nan,0.4642857142857143,0.5,nan,nan +routing2,41,159,nan,nan,0.32142857142857145,0.6785714285714286,nan,nan +routing2,41,160,0.0,0.62,0.21428571428571427,0.75,0.0,0.62 +routing2,41,161,nan,nan,0.75,0.25,nan,nan +routing2,41,162,nan,nan,0.75,0.25,nan,nan +routing2,41,163,nan,nan,0.9285714285714286,0.03571428571428571,nan,nan +routing2,41,164,nan,nan,0.4642857142857143,0.5357142857142857,nan,nan +routing2,41,165,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan +routing2,41,166,nan,nan,0.7142857142857143,0.25,nan,nan +routing2,41,167,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan +routing2,41,168,nan,nan,0.6071428571428571,0.39285714285714285,nan,nan +routing2,41,169,nan,nan,0.5714285714285714,0.42857142857142855,nan,nan +routing2,41,170,0.0,0.62,0.7142857142857143,0.25,0.0,0.62 +routing2,41,171,nan,nan,0.8571428571428571,0.14285714285714285,nan,nan +routing2,41,172,nan,nan,0.6785714285714286,0.2857142857142857,nan,nan +routing2,41,173,nan,nan,0.75,0.25,nan,nan +routing2,41,174,nan,nan,0.8928571428571429,0.10714285714285714,nan,nan +routing2,41,175,nan,nan,0.6428571428571429,0.32142857142857145,nan,nan +routing2,41,176,nan,nan,0.6071428571428571,0.39285714285714285,nan,nan +routing2,41,177,nan,nan,0.6428571428571429,0.35714285714285715,nan,nan +routing2,41,178,nan,nan,0.6785714285714286,0.32142857142857145,nan,nan +routing2,41,179,nan,nan,0.7142857142857143,0.25,nan,nan +routing2,41,180,0.0,0.62,0.42857142857142855,0.5714285714285714,0.0,0.62 +routing2,41,181,nan,nan,0.8571428571428571,0.14285714285714285,nan,nan +routing2,41,182,nan,nan,0.32142857142857145,0.6785714285714286,nan,nan +routing2,41,183,nan,nan,0.35714285714285715,0.6071428571428571,nan,nan +routing2,41,184,nan,nan,0.6071428571428571,0.39285714285714285,nan,nan +routing2,41,185,nan,nan,0.7857142857142857,0.21428571428571427,nan,nan +routing2,41,186,nan,nan,0.8214285714285714,0.17857142857142858,nan,nan +routing2,41,187,nan,nan,0.9642857142857143,0.0,nan,nan +routing2,41,188,nan,nan,0.8928571428571429,0.10714285714285714,nan,nan +routing2,41,189,nan,nan,0.35714285714285715,0.6428571428571429,nan,nan +routing2,41,190,0.0,0.62,0.6428571428571429,0.35714285714285715,0.0,0.62 +routing2,41,191,nan,nan,0.75,0.25,nan,nan +routing2,41,192,nan,nan,0.6428571428571429,0.35714285714285715,nan,nan +routing2,41,193,nan,nan,0.8571428571428571,0.14285714285714285,nan,nan +routing2,41,194,nan,nan,0.8571428571428571,0.14285714285714285,nan,nan +routing2,41,195,nan,nan,0.9285714285714286,0.07142857142857142,nan,nan +routing2,41,196,nan,nan,0.8214285714285714,0.17857142857142858,nan,nan +routing2,41,197,nan,nan,0.5,0.5,nan,nan +routing2,41,198,nan,nan,0.32142857142857145,0.6785714285714286,nan,nan +routing2,41,199,0.0,0.61,0.32142857142857145,0.6428571428571429,0.0,0.61 +vanilla,41,0,0.0,0.33,0.0,0.14285714285714285,0.0,0.33 +vanilla,41,1,nan,nan,0.0,0.17857142857142858,nan,nan +vanilla,41,2,nan,nan,0.0,0.0,nan,nan +vanilla,41,3,nan,nan,0.0,0.17857142857142858,nan,nan +vanilla,41,4,nan,nan,0.0,0.0,nan,nan +vanilla,41,5,nan,nan,0.0,0.4642857142857143,nan,nan +vanilla,41,6,nan,nan,0.0,0.25,nan,nan +vanilla,41,7,nan,nan,0.0,0.14285714285714285,nan,nan +vanilla,41,8,nan,nan,0.0,0.07142857142857142,nan,nan +vanilla,41,9,nan,nan,0.0,0.42857142857142855,nan,nan +vanilla,41,10,nan,nan,0.0,0.25,nan,nan +vanilla,41,11,nan,nan,0.0,0.42857142857142855,nan,nan +vanilla,41,12,nan,nan,0.0,0.25,nan,nan +vanilla,41,13,nan,nan,0.0,0.14285714285714285,nan,nan +vanilla,41,14,nan,nan,0.0,0.32142857142857145,nan,nan +vanilla,41,15,nan,nan,0.0,0.35714285714285715,nan,nan +vanilla,41,16,nan,nan,0.0,0.35714285714285715,nan,nan +vanilla,41,17,nan,nan,0.0,0.17857142857142858,nan,nan +vanilla,41,18,nan,nan,0.0,0.6428571428571429,nan,nan +vanilla,41,19,nan,nan,0.0,0.10714285714285714,nan,nan +vanilla,41,20,0.0,0.48,0.0,0.6785714285714286,0.0,0.48 +vanilla,41,21,nan,nan,0.0,0.4642857142857143,nan,nan +vanilla,41,22,nan,nan,0.0,0.25,nan,nan +vanilla,41,23,nan,nan,0.0,0.5714285714285714,nan,nan +vanilla,41,24,nan,nan,0.0,0.17857142857142858,nan,nan +vanilla,41,25,nan,nan,0.03571428571428571,0.25,nan,nan +vanilla,41,26,nan,nan,0.0,0.0,nan,nan +vanilla,41,27,nan,nan,0.0,0.6428571428571429,nan,nan +vanilla,41,28,nan,nan,0.0,0.25,nan,nan +vanilla,41,29,nan,nan,0.0,0.5357142857142857,nan,nan +vanilla,41,30,nan,nan,0.03571428571428571,0.0,nan,nan +vanilla,41,31,nan,nan,0.0,0.17857142857142858,nan,nan +vanilla,41,32,nan,nan,0.0,0.7142857142857143,nan,nan +vanilla,41,33,nan,nan,0.07142857142857142,0.25,nan,nan +vanilla,41,34,nan,nan,0.10714285714285714,0.2857142857142857,nan,nan +vanilla,41,35,nan,nan,0.0,0.5,nan,nan +vanilla,41,36,nan,nan,0.14285714285714285,0.42857142857142855,nan,nan +vanilla,41,37,nan,nan,0.07142857142857142,0.4642857142857143,nan,nan +vanilla,41,38,nan,nan,0.07142857142857142,0.5357142857142857,nan,nan +vanilla,41,39,nan,nan,0.32142857142857145,0.35714285714285715,nan,nan +vanilla,41,40,0.17,0.5,0.07142857142857142,0.35714285714285715,0.17,0.5 +vanilla,41,41,nan,nan,0.17857142857142858,0.35714285714285715,nan,nan +vanilla,41,42,nan,nan,0.42857142857142855,0.03571428571428571,nan,nan +vanilla,41,43,nan,nan,0.39285714285714285,0.07142857142857142,nan,nan +vanilla,41,44,nan,nan,0.17857142857142858,0.25,nan,nan +vanilla,41,45,nan,nan,0.21428571428571427,0.25,nan,nan +vanilla,41,46,nan,nan,0.07142857142857142,0.5357142857142857,nan,nan +vanilla,41,47,nan,nan,0.17857142857142858,0.5357142857142857,nan,nan +vanilla,41,48,nan,nan,0.10714285714285714,0.17857142857142858,nan,nan +vanilla,41,49,nan,nan,0.0,0.8214285714285714,nan,nan +vanilla,41,50,nan,nan,0.17857142857142858,0.42857142857142855,nan,nan +vanilla,41,51,nan,nan,0.10714285714285714,0.5714285714285714,nan,nan +vanilla,41,52,nan,nan,0.10714285714285714,0.2857142857142857,nan,nan +vanilla,41,53,nan,nan,0.42857142857142855,0.0,nan,nan +vanilla,41,54,nan,nan,0.0,0.5357142857142857,nan,nan +vanilla,41,55,nan,nan,0.03571428571428571,0.6428571428571429,nan,nan +vanilla,41,56,nan,nan,0.39285714285714285,0.25,nan,nan +vanilla,41,57,nan,nan,0.2857142857142857,0.4642857142857143,nan,nan +vanilla,41,58,nan,nan,0.2857142857142857,0.21428571428571427,nan,nan +vanilla,41,59,nan,nan,0.2857142857142857,0.39285714285714285,nan,nan +vanilla,41,60,0.25,0.55,0.6785714285714286,0.07142857142857142,0.25,0.55 +vanilla,41,61,nan,nan,0.32142857142857145,0.42857142857142855,nan,nan +vanilla,41,62,nan,nan,0.21428571428571427,0.5357142857142857,nan,nan +vanilla,41,63,nan,nan,0.17857142857142858,0.42857142857142855,nan,nan +vanilla,41,64,nan,nan,0.39285714285714285,0.21428571428571427,nan,nan +vanilla,41,65,nan,nan,0.07142857142857142,0.35714285714285715,nan,nan +vanilla,41,66,nan,nan,0.32142857142857145,0.25,nan,nan +vanilla,41,67,nan,nan,0.5714285714285714,0.2857142857142857,nan,nan +vanilla,41,68,nan,nan,0.6785714285714286,0.07142857142857142,nan,nan +vanilla,41,69,nan,nan,0.4642857142857143,0.25,nan,nan +vanilla,41,70,nan,nan,0.39285714285714285,0.25,nan,nan +vanilla,41,71,nan,nan,0.39285714285714285,0.25,nan,nan +vanilla,41,72,nan,nan,0.25,0.42857142857142855,nan,nan +vanilla,41,73,nan,nan,0.32142857142857145,0.14285714285714285,nan,nan +vanilla,41,74,nan,nan,0.5714285714285714,0.07142857142857142,nan,nan +vanilla,41,75,nan,nan,0.0,0.8928571428571429,nan,nan +vanilla,41,76,nan,nan,0.25,0.03571428571428571,nan,nan +vanilla,41,77,nan,nan,0.2857142857142857,0.42857142857142855,nan,nan +vanilla,41,78,nan,nan,0.6785714285714286,0.03571428571428571,nan,nan +vanilla,41,79,nan,nan,0.32142857142857145,0.32142857142857145,nan,nan +vanilla,41,80,0.22,0.5,0.39285714285714285,0.25,0.22,0.5 +vanilla,41,81,nan,nan,0.14285714285714285,0.4642857142857143,nan,nan +vanilla,41,82,nan,nan,0.7142857142857143,0.0,nan,nan +vanilla,41,83,nan,nan,0.42857142857142855,0.32142857142857145,nan,nan +vanilla,41,84,nan,nan,0.03571428571428571,0.7142857142857143,nan,nan +vanilla,41,85,nan,nan,0.39285714285714285,0.10714285714285714,nan,nan +vanilla,41,86,nan,nan,0.5357142857142857,0.17857142857142858,nan,nan +vanilla,41,87,nan,nan,0.07142857142857142,0.5,nan,nan +vanilla,41,88,nan,nan,0.10714285714285714,0.4642857142857143,nan,nan +vanilla,41,89,nan,nan,0.35714285714285715,0.42857142857142855,nan,nan +vanilla,41,90,nan,nan,0.17857142857142858,0.5357142857142857,nan,nan +vanilla,41,91,nan,nan,0.32142857142857145,0.6428571428571429,nan,nan +vanilla,41,92,nan,nan,0.35714285714285715,0.5357142857142857,nan,nan +vanilla,41,93,nan,nan,0.03571428571428571,0.39285714285714285,nan,nan +vanilla,41,94,nan,nan,0.5,0.25,nan,nan +vanilla,41,95,nan,nan,0.2857142857142857,0.17857142857142858,nan,nan +vanilla,41,96,nan,nan,0.4642857142857143,0.25,nan,nan +vanilla,41,97,nan,nan,0.2857142857142857,0.2857142857142857,nan,nan +vanilla,41,98,nan,nan,0.39285714285714285,0.14285714285714285,nan,nan +vanilla,41,99,nan,nan,0.07142857142857142,0.5357142857142857,nan,nan +vanilla,41,100,0.28,0.47,0.25,0.35714285714285715,0.28,0.47 +vanilla,41,101,nan,nan,0.10714285714285714,0.7142857142857143,nan,nan +vanilla,41,102,nan,nan,0.42857142857142855,0.35714285714285715,nan,nan +vanilla,41,103,nan,nan,0.7142857142857143,0.0,nan,nan +vanilla,41,104,nan,nan,0.35714285714285715,0.5,nan,nan +vanilla,41,105,nan,nan,0.35714285714285715,0.32142857142857145,nan,nan +vanilla,41,106,nan,nan,0.25,0.17857142857142858,nan,nan +vanilla,41,107,nan,nan,0.5,0.32142857142857145,nan,nan +vanilla,41,108,nan,nan,0.5,0.25,nan,nan +vanilla,41,109,nan,nan,0.7142857142857143,0.10714285714285714,nan,nan +vanilla,41,110,nan,nan,0.39285714285714285,0.42857142857142855,nan,nan +vanilla,41,111,nan,nan,0.39285714285714285,0.39285714285714285,nan,nan +vanilla,41,112,nan,nan,0.21428571428571427,0.5,nan,nan +vanilla,41,113,nan,nan,0.5714285714285714,0.2857142857142857,nan,nan +vanilla,41,114,nan,nan,0.10714285714285714,0.5357142857142857,nan,nan +vanilla,41,115,nan,nan,0.32142857142857145,0.10714285714285714,nan,nan +vanilla,41,116,nan,nan,0.32142857142857145,0.21428571428571427,nan,nan +vanilla,41,117,nan,nan,0.5,0.25,nan,nan +vanilla,41,118,nan,nan,0.03571428571428571,0.32142857142857145,nan,nan +vanilla,41,119,nan,nan,0.14285714285714285,0.4642857142857143,nan,nan +vanilla,41,120,0.33,0.41,0.5357142857142857,0.17857142857142858,0.33,0.41 +vanilla,41,121,nan,nan,0.5,0.35714285714285715,nan,nan +vanilla,41,122,nan,nan,0.2857142857142857,0.42857142857142855,nan,nan +vanilla,41,123,nan,nan,0.5714285714285714,0.03571428571428571,nan,nan +vanilla,41,124,nan,nan,0.35714285714285715,0.4642857142857143,nan,nan +vanilla,41,125,nan,nan,0.5714285714285714,0.17857142857142858,nan,nan +vanilla,41,126,nan,nan,0.35714285714285715,0.25,nan,nan +vanilla,41,127,nan,nan,0.25,0.42857142857142855,nan,nan +vanilla,41,128,nan,nan,0.17857142857142858,0.39285714285714285,nan,nan +vanilla,41,129,nan,nan,0.39285714285714285,0.21428571428571427,nan,nan +vanilla,41,130,nan,nan,0.42857142857142855,0.25,nan,nan +vanilla,41,131,nan,nan,0.2857142857142857,0.5,nan,nan +vanilla,41,132,nan,nan,0.03571428571428571,0.5357142857142857,nan,nan +vanilla,41,133,nan,nan,0.39285714285714285,0.5,nan,nan +vanilla,41,134,nan,nan,0.17857142857142858,0.5357142857142857,nan,nan +vanilla,41,135,nan,nan,0.42857142857142855,0.2857142857142857,nan,nan +vanilla,41,136,nan,nan,0.32142857142857145,0.35714285714285715,nan,nan +vanilla,41,137,nan,nan,0.42857142857142855,0.39285714285714285,nan,nan +vanilla,41,138,nan,nan,0.32142857142857145,0.39285714285714285,nan,nan +vanilla,41,139,nan,nan,0.32142857142857145,0.4642857142857143,nan,nan +vanilla,41,140,0.28,0.45,0.25,0.03571428571428571,0.28,0.45 +vanilla,41,141,nan,nan,0.4642857142857143,0.10714285714285714,nan,nan +vanilla,41,142,nan,nan,0.6785714285714286,0.21428571428571427,nan,nan +vanilla,41,143,nan,nan,0.5357142857142857,0.21428571428571427,nan,nan +vanilla,41,144,nan,nan,0.4642857142857143,0.4642857142857143,nan,nan +vanilla,41,145,nan,nan,0.39285714285714285,0.14285714285714285,nan,nan +vanilla,41,146,nan,nan,0.42857142857142855,0.35714285714285715,nan,nan +vanilla,41,147,nan,nan,0.03571428571428571,0.35714285714285715,nan,nan +vanilla,41,148,nan,nan,0.42857142857142855,0.35714285714285715,nan,nan +vanilla,41,149,nan,nan,0.32142857142857145,0.39285714285714285,nan,nan +vanilla,41,150,nan,nan,0.5357142857142857,0.25,nan,nan +vanilla,41,151,nan,nan,0.21428571428571427,0.42857142857142855,nan,nan +vanilla,41,152,nan,nan,0.39285714285714285,0.4642857142857143,nan,nan +vanilla,41,153,nan,nan,0.42857142857142855,0.35714285714285715,nan,nan +vanilla,41,154,nan,nan,0.17857142857142858,0.4642857142857143,nan,nan +vanilla,41,155,nan,nan,0.5,0.21428571428571427,nan,nan +vanilla,41,156,nan,nan,0.03571428571428571,0.5357142857142857,nan,nan +vanilla,41,157,nan,nan,0.6785714285714286,0.17857142857142858,nan,nan +vanilla,41,158,nan,nan,0.5357142857142857,0.21428571428571427,nan,nan +vanilla,41,159,nan,nan,0.03571428571428571,0.42857142857142855,nan,nan +vanilla,41,160,0.33,0.44,0.17857142857142858,0.75,0.33,0.44 +vanilla,41,161,nan,nan,0.6428571428571429,0.21428571428571427,nan,nan +vanilla,41,162,nan,nan,0.5357142857142857,0.25,nan,nan +vanilla,41,163,nan,nan,0.5714285714285714,0.10714285714285714,nan,nan +vanilla,41,164,nan,nan,0.17857142857142858,0.6785714285714286,nan,nan +vanilla,41,165,nan,nan,0.4642857142857143,0.39285714285714285,nan,nan +vanilla,41,166,nan,nan,0.5714285714285714,0.14285714285714285,nan,nan +vanilla,41,167,nan,nan,0.4642857142857143,0.25,nan,nan +vanilla,41,168,nan,nan,0.35714285714285715,0.14285714285714285,nan,nan +vanilla,41,169,nan,nan,0.5,0.32142857142857145,nan,nan +vanilla,41,170,nan,nan,0.6785714285714286,0.17857142857142858,nan,nan +vanilla,41,171,nan,nan,0.6428571428571429,0.07142857142857142,nan,nan +vanilla,41,172,nan,nan,0.35714285714285715,0.32142857142857145,nan,nan +vanilla,41,173,nan,nan,0.5357142857142857,0.25,nan,nan +vanilla,41,174,nan,nan,0.6428571428571429,0.14285714285714285,nan,nan +vanilla,41,175,nan,nan,0.32142857142857145,0.42857142857142855,nan,nan +vanilla,41,176,nan,nan,0.42857142857142855,0.39285714285714285,nan,nan +vanilla,41,177,nan,nan,0.25,0.35714285714285715,nan,nan +vanilla,41,178,nan,nan,0.4642857142857143,0.14285714285714285,nan,nan +vanilla,41,179,nan,nan,0.6785714285714286,0.25,nan,nan +vanilla,41,180,0.39,0.5,0.17857142857142858,0.39285714285714285,0.39,0.5 +vanilla,41,181,nan,nan,0.42857142857142855,0.14285714285714285,nan,nan +vanilla,41,182,nan,nan,0.03571428571428571,0.5357142857142857,nan,nan +vanilla,41,183,nan,nan,0.2857142857142857,0.39285714285714285,nan,nan +vanilla,41,184,nan,nan,0.4642857142857143,0.14285714285714285,nan,nan +vanilla,41,185,nan,nan,0.4642857142857143,0.17857142857142858,nan,nan +vanilla,41,186,nan,nan,0.14285714285714285,0.14285714285714285,nan,nan +vanilla,41,187,nan,nan,0.6071428571428571,0.0,nan,nan +vanilla,41,188,nan,nan,0.9285714285714286,0.03571428571428571,nan,nan +vanilla,41,189,nan,nan,0.07142857142857142,0.6785714285714286,nan,nan +vanilla,41,190,nan,nan,0.6071428571428571,0.32142857142857145,nan,nan +vanilla,41,191,nan,nan,0.5,0.25,nan,nan +vanilla,41,192,nan,nan,0.5,0.25,nan,nan +vanilla,41,193,nan,nan,0.6785714285714286,0.2857142857142857,nan,nan +vanilla,41,194,nan,nan,0.5714285714285714,0.14285714285714285,nan,nan +vanilla,41,195,nan,nan,0.17857142857142858,0.07142857142857142,nan,nan +vanilla,41,196,nan,nan,0.6785714285714286,0.17857142857142858,nan,nan +vanilla,41,197,nan,nan,0.42857142857142855,0.35714285714285715,nan,nan +vanilla,41,198,nan,nan,0.14285714285714285,0.5357142857142857,nan,nan +vanilla,41,199,0.34,0.5,0.14285714285714285,0.4642857142857143,0.34,0.5