Crossword SNITCH

A quantitative guide to the degree of difficulty of the Times Cryptic Crossword

Solver Types and a Neutrino Detector

The SNITCH has always relied on a set of Reference solvers to calculate the difficulty of the crossword. Updating this list over time has led me to look at different types of solver. In particular, it has been important to detect and remove "Neutrinos" from the data (see further below). Once this is done we can look at other types of solver more clearly.

What's a Neutrino?

Neutrino – A person who manually solves the puzzle on paper, and then goes to the Crossword Club and types in the answers as rapidly as possible, either in order to give a high position on the leaderboard or because they are entering a typing competition. (Times for the Times glossary definition)

Have you noticed that the top of the Times Cryptic Crossword Club leaderboard is occupied by solvers who have some remarkable completion times? How does someone solve the puzzle in around 2 minutes, when it probably takes that long to just write in the answers?

On the Times for the Times blog site, we've come to know these solvers as "Neutrinos", a term coined by Tony Sever some years back to describe those people who like to occupy the top spots on the leaderboard without actually being top-notch solvers. The theory is that these people do the crossword on paper, then transcribe the answers on the Crossword Club interface.

And the big question is: how can we detect these? Some of them are pretty obvious: if you look at the results at the table on the right, the top solver in recent months is devlin with an average solving time of 00:41 (min:sec). Given that this is faster than average times of the known best solvers, we're sure that this is not a real solving time. But it's much harder to tell when you're talking about average times that are in the realms of possibility. Who are the Neutrinos and who are the real solvers? This page tries to answer that question.

Clusters of solvers

The chart below shows a way to separate Neutrinos from other solvers. It plots each solver's average solving time (in seconds) on the x-axis against an "alignment to SNITCH" factor on the y-axis. This alignment factor is 1 when, on average, a solver's personal NITCH rating for a crossword is proportional to the SNITCH rating for that crossword. It is 0 when there is no alignment. (For those interested, more detail on this is provided below).

The blue dots on this chart represent the Reference solvers for the SNITCH as of Oct 2018. (Note that you can hover over each point to see the name of the individual solver.) As you'd expect, these are clustered around an alignment factor of 1 (generally between 0.5 and 1.5) regardless of their average solving time.

The red dots represent solvers who have been around for some time but are not Reference solvers. A group of these is spread across the range of average solving times and also spread about the SNITCH alignment factor of 1. But there's a cluster of red dots in the lower left corner that has low solving times and is spread around an alignment factor of 0. These are the classic-style Neutrinos - those who are very fast on average, regardless of how hard the puzzles are.

This data suggests that any solver with a solving time of less than, say, 8.0 minutes and a SNITCH alignment factor of, say, less than 0.5 could be safely classified as a Neutrino.

The grey dots represent new solvers since the Reference solver list was baselined in Oct 2018>. We can now see that some of these are clearly Neutrinos (the ones in the cluster at the lower left, for example). Others with low solving times need further investigation, and we do this by checking the details of their alignment with the SNITCH.

Remaining Questions

We see that some solvers have alignment to the SNITCH figures well above 1, which would suggest that they seems to find harder puzzles especially hard. These solvers often have small data sets, including those with relatively high average solving times that don't always make the top 100 on the leaderboard. With the smaller amount of data, the alignment is likely to be less reflective of their true performance.

Blog Solvers: adding solving times from the blog

On the Times for the Times blog site, solvers regularly report their solving times. Where they have allowed it, we now add them to the list of solvers and track their progress. This is a new category of solver, the Blog Solver, for those who've reported solving times regularly over the last six months.

Notes to Blog Solvers:

  • the most reliable format for reporting times is with format "mm:ss" or as "x minutes" in the title or at the start of the entry
  • only the first main comment for each blogger is used; responses to other comments or a second comment is ignored.
  • to report errors, include "n errors" just after the time
  • If you just have a time it is assumed you have no errors unless you mention DNF or pink squares or giving up, etc, in the text
  • Examples of good time notifications are "38:30, 0 errors" and "39 minutes, 0 errors" in the comment title or as the first part of your comment
  • This info is also available using the "Blog Solver" button on the right hand side of the detailed crossword solving times for each crossword

Updating solver status

This analysis allows me to reclassify solvers, as shown in the chart below. One of my main motivations is to be able to update the list of Reference solvers reliably. I'd like to be able to include new solvers (especially good ones) without accidentally including Neutrinos. And I'd like to track other non-Reference and non-Neutrino solvers, even if their data isn't used for the SNITCH.

So I can now classify solvers as follows:

Neutrino
Those with fast solving times and low or inconsistent alignment to the SNITCH (shown in orange)
Reference Solvers
Those aligned to the SNITCH and having an average solving time of less than 45 mins (shown in blue)
Tracked Solvers
Those that don't meet the conditions for Reference Solvers but I can be fairly sure are not Neutrinos (shown in red)
Blog Solvers
Those that report their solving times in the Times for the Times site (shown in purple)

New solvers will come into the list over time and can be reclassified on my next update.

I've shown the old and new status in the full table to the right so that you can track the changes for each user.

So what's the SNITCH alignment factor?

This is actually pretty straightforward if you know a little maths. I plot the solver's individual NITCH scores agains the corresponding SNITCH for the same puzzle and measure the slope of the line of best fit. A slope of 1 indicates that the results are proportional, a slope of 0 means that there's no correlation.

For example, verlaine has results as shown in the chart below. Easier puzzles (according to the SNITCH) are on the left of the x-axis, harder ones on the right. verlaine's NITCH results vary, but are generally higher as we progress from left to right. The overall slope of the line of best fit is 1.26, showing good alignment with the SNITCH on average.

In contrast, lucyg43484 has results as shown in the chart below. There is no correlation with the hardness of the puzzle according to the SNITCH. In fact, the slope is negative, meaning that on average the harder puzzles are easier for lucyg43484 than the easier ones. This lack of correlation is exactly what you'd expect if the solver is just typing in known answers.

Nothing is simple and we have some solvers with a mix of results like the ones shown in the chart below. The correlation with the SNITCH is inconsistent - good on some solutions but not on others. On the latter, the solver looks just like a Neutrino, with short response times regardless of the SNITCH value. Presumably they type the answers in directly on these shorter puzzles. For this reason, where we detect this sort of solver, we will mark it manually as a Neutrino.

Solving times for club members

The table below shows crossword club solvers who have submitted more than 20 solutions in the last six months, with an average solving time of less than 60 minutes for an error-free crossword. They are ranked by that solving time. It also indicates their status, including whether they are Reference solvers for calculation of the daily SNITCH.

Rank Solver Status - Oct 2018 Current Status Average Time SNITCH Alignment
1 devlin tracked neutrino 00:41 -0.07
2 2 Down tracked neutrino 02:00 0.08
3 Southern Cross new_solver neutrino 02:26 0.11
4 TimA tracked neutrino 02:49 -0.01
5 niq.dow new_solver neutrino 02:53 -0.06
6 sarahsolomon new_solver neutrino 03:16 0.05
7 Stefan Szulc tracked neutrino 03:17 -0.08
8 Margaut tracked neutrino 03:24 0.18
9 robertsonjon new_solver neutrino 03:30 0.23
10 Henry Wyatt tracked neutrino 03:31 0.1
11 bmag new_solver neutrino 03:32 0.07
12 willperf new_solver neutrino 03:37 0.05
13 seamus.butler new_solver neutrino 03:38 0.03
14 chaffinch new_solver neutrino 03:46 -0.05
15 GolfDocAndy tracked neutrino 03:51 -0.08
16 childshouse new_solver neutrino 03:53 0.11
17 BrianS tracked neutrino 03:54 -0.0
18 hazeltearne new_solver neutrino 03:56 -0.07
19 accessit new_solver neutrino 04:00 0.01
20 C M Gilles new_solver neutrino 04:20 -0.04
21 ray lewis tracked neutrino 04:29 0.0
22 mohn reference reference 04:40 1.05
23 Balbec tracked neutrino 04:41 -0.07
24 AlanRichens new_solver neutrino 05:06 0.07
25 chaswil tracked neutrino 05:10 0.17
26 Pontius tracked neutrino 05:16 0.09
27 antigone new_solver neutrino 05:31 -0.0
28 kenhors new_solver neutrino 05:41 -0.01
29 Pnmcg new_solver neutrino 05:53 0.05
30 Diskus tracked reference 05:54 0.94
31 Nathan Panning new_solver reference 05:56 0.83
32 Mikemon tracked tracked 06:00 0.54
33 Jason reference reference 06:03 0.85
34 lili tracked reference 06:29 0.99
35 Magoo reference reference 06:32 1.07
36 verlaine reference reference 06:33 1.26
37 robertscottf new_solver neutrino 06:36 -0.44
38 mistigris reference reference 06:38 1.2
39 lucyg43484 new_solver neutrino 06:40 -1.38
40 DaddyM tracked tracked 06:46 0.55
41 mauefw new_solver reference 06:46 1.08
42 hilarym tracked reference 07:05 0.99
43 Paul Gilbert tracked tracked 07:20 1.31
44 aphis99 reference reference 07:23 1.01
45 cmjhutton new_solver tracked 07:41 1.51
46 greggybell tracked neutrino 07:43 0.86
47 richard reference reference 08:37 0.89
48 Contrarian3 new_solver reference 08:46 0.6
49 Strober new_solver reference 08:48 0.66
50 asaldanha reference reference 09:07 1.03
51 boulemiche tracked reference 09:09 0.6
52 glheard reference reference 09:20 0.92
53 Dr Dolittle new_solver reference 09:34 1.76
54 markdobell new_solver reference 09:58 1.22
55 patrickcates tracked reference 10:01 1.14
56 chindit reference reference 10:08 0.98
57 tiggis tracked reference 10:15 1.36
58 Kinghedger tracked reference 10:21 1.16
59 Umpire new_solver reference 10:22 1.07
60 samgdavies new_solver reference 10:31 0.66
61 Heyesey tracked reference 10:33 1.25
62 lickert reference reference 10:34 0.92
63 Deane Short new_solver reference 10:45 1.05
64 philjordan1147 new_solver reference 10:51 1.06
65 xyster reference reference 10:58 0.61
66 Topical Tim reference reference 11:01 1.17
67 miked1961 tracked reference 11:01 1.26
68 keriothe_ reference reference 11:12 1.13
69 KenD51 tracked tracked 11:14 -0.1
70 scrabbler new_solver reference 11:20 1.09
71 AlanS reference reference 11:23 1.05
72 HoneyBadger new_solver reference 11:25 1.02
73 Golvellius tracked reference 11:40 0.98
74 SimonAnthony reference reference 11:41 1.42
75 fshephe reference reference 11:43 0.63
76 neilr reference reference 11:44 1.04
77 Sheapey reference reference 11:44 1.24
78 Tom Stubbs reference reference 11:50 1.26
79 chriswords reference reference 11:54 0.95
80 Morphosis new_solver reference 12:00 1.15
81 David Crooks reference reference 12:03 0.92
82 fuzz tracked tracked 12:03 0.18
83 andy tracked reference 12:04 0.9
84 Henry White new_solver reference 12:14 1.06
85 d.middleton new_solver reference 12:17 1.1
86 Stavros reference reference 12:25 1.15
87 canismiser new_solver reference 12:29 1.28
88 ChuckB tracked reference 12:40 1.01
89 JimboFS new_solver reference 12:42 0.94
90 Silva reference reference 12:42 1.02
91 John Walsh tracked reference 12:44 0.75
92 Jim Willis new_solver reference 12:44 1.35
93 edwards.robert1 tracked tracked 12:49 0.05
94 michaelbell53 new_solver tracked 12:52 0.38
95 Paul Bacon new_solver reference 12:57 0.92
96 aphasic tracked reference 13:01 1.07
97 BinLinerBob new_solver tracked 13:02 0.39
98 tilbee new_solver reference 13:05 1.11
99 SimonB new_solver tracked 13:12 0.28
100 Ed freshpot reference reference 13:17 0.9
101 March new_solver reference 13:20 1.13
102 christopherclark4945 new_solver reference 13:26 1.36
103 MikeOsborne reference reference 13:27 1.0
104 7dPenguin tracked reference 13:27 1.37
105 chriss new_solver reference 13:30 1.69
106 Groucho reference reference 13:39 1.08
107 robertL tracked reference 13:42 1.44
108 Penfold_61 new_solver reference 13:51 1.07
109 Eddddddd tracked reference 14:05 1.23
110 Viscomte tracked reference 14:07 0.47
111 LouWeed reference reference 14:08 1.01
112 Ben Staveley reference reference 14:08 1.15
113 franceslc11 new_solver reference 14:16 0.93
114 alexh tracked reference 14:16 0.62
115 Peponi13 new_solver reference 14:19 0.93
116 Crucifer tracked reference 14:22 1.16
117 fishernick79 tracked reference 14:22 0.97
118 njnclarke tracked reference 14:23 0.96
119 CentralLine tracked reference 14:23 1.27
120 Secondbass new_solver reference 14:28 0.59
121 Tibthorpe reference reference 14:29 1.12
122 Semillon tracked reference 14:29 1.26
123 Aloysius tracked tracked 14:36 0.31
124 howardwilde1 new_solver reference 14:36 0.96
125 myles tracked reference 14:41 0.93
126 BlackburnRover new_solver reference 14:44 0.5
127 Finzi new_solver reference 14:45 0.61
128 benedick reference tracked 14:49 0.45
129 cdb_100 tracked reference 14:54 1.14
130 Mike Mansbridge new_solver tracked 14:55 2.67
131 gabrojak new_solver reference 14:55 1.12
132 Pootle new_solver reference 15:02 1.42
133 Johninterred new_solver blog_solver 15:06 1.22
134 phthisis reference reference 15:07 1.03
135 AndyR tracked reference 15:16 0.74
136 GeorgeTz new_solver reference 15:17 0.91
137 grape tracked reference 15:18 1.57
138 john.brassey new_solver tracked 15:18 0.15
139 zinzan new_solver reference 15:21 1.11
140 JezWoolfrey reference reference 15:39 1.2
141 robinh reference reference 15:43 0.65
142 tapbarker tracked reference 15:44 1.19
143 RobR reference reference 15:49 1.19
144 LJCN new_solver reference 15:55 1.13
145 pitcaithlie new_solver reference 15:59 1.65
146 Looch reference reference 16:02 1.04
147 Achernar tracked reference 16:03 0.73
148 Squallaby reference reference 16:04 1.7
149 TB22 new_solver tracked 16:04 2.36
150 john.marshall new_solver reference 16:13 0.83
151 MK76 tracked reference 16:17 1.02
152 andrewlake tracked reference 16:18 1.07
153 rupes new_solver reference 16:18 1.6
154 Freemers new_solver reference 16:19 0.8
155 daulbs tracked reference 16:27 1.36
156 Blackbeard tracked reference 16:33 1.15
157 ajcauk1 new_solver reference 16:47 0.66
158 MrChumley tracked tracked 16:53 0.44
159 ilan new_solver reference 17:02 0.61
160 jimwetzler tracked reference 17:03 0.82
161 cmcnsmith new_solver reference 17:15 0.48
162 Obrador new_solver reference 17:20 1.11
163 Crossiant new_solver reference 17:21 1.32
164 Craven reference reference 17:24 0.71
165 DunPangolin new_solver reference 17:24 0.86
166 Jeremy S new_solver reference 17:29 1.04
167 Encota new_solver reference 17:30 1.3
168 tds new_solver reference 17:31 0.8
169 Galspray tracked reference 17:35 1.3
170 jeremy.kenyon new_solver reference 17:37 0.99
171 PGooden reference reference 17:53 1.04
172 GMcD reference reference 17:57 1.19
173 earlylight tracked reference 18:00 0.49
174 Foozler new_solver reference 18:00 0.57
175 Colin2355 new_solver reference 18:14 1.26
176 MossDef new_solver reference 18:18 0.96
177 DanSolo new_solver reference 18:20 1.11
178 pterodactyl reference reference 18:22 0.82
179 npweston new_solver reference 18:25 0.63
180 Swanny tracked reference 18:31 1.98
181 Cookincats tracked reference 18:31 1.57
182 hopkinb new_solver reference 18:36 1.36
183 KET tracked reference 18:40 1.09
184 Andrew Whiffin new_solver reference 18:40 1.18
185 Solver52 reference tracked 18:47 0.32
186 martinede new_solver reference 18:50 0.9
187 rrricharrrd tracked reference 18:53 0.98
188 Dzhigit tracked reference 18:53 1.08
189 Mike C new_solver reference 18:54 1.07
190 Dvynys new_solver reference 18:56 1.27
191 chriswestontour new_solver reference 18:58 1.36
192 julian_w tracked reference 19:00 1.04
193 Gallion Fish new_solver reference 19:01 0.97
194 LuckOfLucien tracked reference 19:02 1.11
195 pc8 tracked reference 19:10 1.25
196 Riche new_solver reference 19:14 0.92
197 Grestyman tracked reference 19:19 0.95
198 Upfisher new_solver reference 19:39 1.47
199 UisceTe new_solver reference 19:40 1.25
200 gsriordan52 new_solver reference 19:40 1.18
201 Jeremy Weissmann new_solver reference 19:44 1.18
202 Zander tracked reference 19:52 1.21
203 Pxspxs new_solver reference 19:53 0.95
204 M Bennett new_solver reference 19:58 1.2
205 James P tracked reference 19:58 1.44
206 Curarist tracked tracked 20:04 1.0
207 Hamish.S new_solver reference 20:04 1.34
208 hugh schofield new_solver reference 20:05 1.27
209 kath tracked reference 20:13 1.22
210 Zabadak3 new_solver reference 20:18 1.03
211 uvofiz new_solver reference 20:20 0.77
212 John Arnold reference reference 20:27 1.32
213 valerian1967 tracked reference 20:28 0.98
214 kate.daly305 new_solver reference 20:33 1.88
215 dec reference reference 20:33 1.22
216 DianeRS new_solver reference 20:35 1.48
217 squark new_solver reference 20:37 0.94
218 daniel.faith new_solver reference 20:37 0.95
219 Ease This Jam new_solver reference 20:38 1.4
220 doublecross tracked reference 20:40 1.75
221 Kevin Gregg reference reference 20:43 1.23
222 Waterloo new_solver reference 20:55 0.96
223 cognominative new_solver reference 21:01 1.33
224 David Bourne tracked reference 21:10 1.3
225 Onelug new_solver reference 21:13 1.08
226 endafk tracked reference 21:15 0.83
227 Nangle tracked reference 21:17 0.98
228 Corymbia new_solver reference 21:25 1.1
229 Jagsfan1971 tracked reference 21:27 1.59
230 The Caffeine Kid new_solver reference 21:32 0.69
231 suethepotterer new_solver tracked 21:40 0.26
232 luxtonj61 new_solver reference 21:45 1.09
233 Leegoods new_solver reference 21:56 1.1
234 george.garlick new_solver reference 21:57 1.11
235 david_ch new_solver blog_solver 21:59 1.25
236 McBeak new_solver reference 22:00 1.02
237 Rod B new_solver reference 22:00 0.95
238 DamienKnapma tracked reference 22:12 0.89
239 frost tracked reference 22:24 1.29
240 medodd new_solver reference 22:29 0.79
241 Tudds reference reference 22:32 1.05
242 crosswordian reference reference 22:38 0.92
243 Terrier new_solver reference 22:43 1.59
244 goblin tracked reference 22:45 0.67
245 richardCV22 tracked reference 22:50 1.26
246 puzzled1 tracked neutrino 22:54 0.74
247 Brenk tracked reference 23:03 1.38
248 1234 reference reference 23:11 1.16
249 jimancliffe new_solver reference 23:32 1.0
250 stainl665 new_solver reference 23:36 1.39
251 Edprof reference reference 23:51 1.2
252 joe.mcgrane new_solver reference 23:51 1.37
253 rjcassidy reference reference 24:03 0.99
254 Crippens1 reference reference 24:09 1.26
255 chris661554 new_solver reference 24:19 1.16
256 klamery4 new_solver reference 24:38 0.72
257 JE59 tracked reference 24:47 1.15
258 JohnDun reference reference 24:49 1.35
259 janesa new_solver reference 25:03 0.8
260 MichelinPoitiers new_solver reference 25:07 1.03
261 Sheen new_solver reference 25:09 1.27
262 rt51 new_solver reference 25:12 1.66
263 brian.mcnamara new_solver reference 25:20 1.32
264 Gussie new_solver reference 25:28 1.39
265 monkfish new_solver reference 25:28 0.7
266 timbo tracked reference 25:30 0.98
267 hugapug new_solver reference 25:31 1.02
268 cyrillic reference reference 25:32 1.16
269 Beagler tracked reference 25:33 1.63
270 Mkgnao reference reference 25:35 0.93
271 tony the butcher montana new_solver reference 25:38 1.4
272 Yatton50 tracked reference 25:39 1.2
273 crucihacker new_solver reference 25:43 1.27
274 eniamretrauq reference reference 25:46 1.12
275 Fidelio new_solver reference 25:57 1.1
276 infinitejest new_solver reference 26:06 1.14
277 JoeyC tracked reference 26:18 1.42
278 BoredAccountant new_solver reference 26:26 1.23
279 pvoller new_solver reference 26:36 1.38
280 Deezzaa new_solver reference 26:38 1.18
281 barracuda reference reference 26:43 1.12
282 Dr_Bob new_solver reference 26:43 1.0
283 joekobi new_solver blog_solver 26:59 1.09
284 SlumdogEngineer tracked reference 27:03 1.66
285 nekabue reference reference 27:11 0.96
286 annikins new_solver reference 27:30 1.65
287 JMbrow29 new_solver reference 27:31 0.64
288 Rowlie26 new_solver reference 27:39 1.24
289 ulaca reference reference 27:55 1.31
290 Mike Harper tracked reference 28:12 1.41
291 6098mr tracked reference 28:23 0.65
292 NAPASAI reference reference 28:28 1.26
293 Pendrov tracked reference 28:29 1.8
294 phcbarnes new_solver tracked 28:59 0.06
295 Rookie new_solver reference 29:08 0.89
296 Winchelt new_solver tracked 29:12 0.18
297 Mudge new_solver reference 29:15 1.38
298 Grumpole new_solver reference 29:31 1.16
299 symbenall2 tracked reference 29:37 1.04
300 RogerC new_solver reference 29:56 1.11
301 SK42 tracked reference 30:26 1.41
302 rosselliot reference reference 30:43 1.12
303 hipponym new_solver reference 31:07 1.3
304 Jeeves reference reference 31:18 1.14
305 Manveru reference reference 31:22 0.94
306 dosbarth new_solver reference 31:26 1.39
307 gbestanley reference reference 31:45 0.65
308 vinyl12345 new_solver reference 31:47 1.47
309 BertieVII new_solver reference 32:28 0.79
310 koro reference reference 32:32 1.04
311 Cryptique new_solver reference 32:46 0.69
312 Maggot tracked tracked 33:20 1.17
313 WordPlodder new_solver reference 33:30 1.26
314 simjt new_solver reference 33:35 0.79
315 alistair.boere new_solver tracked 33:49 0.31
316 CoxBurglar new_solver reference 33:58 0.93
317 bruce.johnston22 new_solver reference 34:09 0.9
318 VictoriaW tracked neutrino 34:14 -0.07
319 Lloyd new_solver reference 34:42 1.04
320 gothick new_solver reference 34:46 0.98
321 j.stanton734 new_solver reference 35:17 1.32
322 starstruck tracked reference 35:23 1.26
323 boltonwanderer new_solver blog_solver 35:25 1.27
324 Michael S new_solver reference 35:32 1.18
325 Birdingbob new_solver reference 35:58 1.54
326 Pleasuredome tracked reference 36:28 1.45
327 tyrotim new_solver reference 36:30 0.89
328 RaghuS tracked neutrino 36:39 0.64
329 joss henry tracked reference 36:54 1.09
330 kapietro new_solver reference 37:18 1.18
331 HanS tracked tracked 37:25 0.32
332 Shushannah tracked reference 37:29 0.98
333 piltdown man new_solver reference 37:54 1.75
334 maryht tracked reference 38:35 0.59
335 rv_1 new_solver reference 39:07 1.21
336 jackk.larg new_solver reference 39:34 1.31
337 hydrochoos tracked reference 39:45 0.65
338 Dalai Farmer new_solver tracked 39:59 1.14
339 baronrob tracked reference 41:00 1.73
340 clivejharlow new_solver reference 44:15 1.43
341 empty reference tracked 45:13 0.78
342 Steve Wood tracked tracked 48:45 0.8
343 MartinP tracked tracked 49:15 1.24
344 kjbr tracked tracked 50:59 1.22
345 The Real Steve Snackman new_solver tracked 51:22 0.78
346 profsjpayne new_solver tracked 53:48 0.78
347 The Mighty Salmon new_solver tracked 55:14 1.2
348 intentional rounding new_solver tracked 55:40 1.01
349 Masha tracked tracked 58:39 1.01
350 KathH new_solver tracked 59:49 0.71