Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021sketch-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.974
2
.973
3
.958
4
.951
5
.946
6
.946
7
.946
8
.945
9
.943
10
.940
11
.938
12
.935
13
.930
14
.927
15
.925
16
.922
17
.919
18
.914
19
.911
20
.910
21
.909
22
.905
23
.905
24
.902
25
.902
26
.897
27
.884
28
.879
29
.873
30
.871
31
.870
32
.869
33
.864
34
.850
35
.833
36
.824
37
.806
38
.799
39
.795
40
.787
41
.784
42
.779
43
.779
44
.767
45
.766
46
.765
47
.760
48
.756
49
.740
50
.736
51
.736
52
.731
53
.730
54
.728
55
.721
56
.719
57
.713
58
.713
59
.706
60
.695
61
.689
62
.686
63
.682
64
.681
65
.681
66
.680
67
.680
68
.680
69
.680
70
.677
71
.677
72
.677
73
.676
74
.675
75
.674
76
.672
77
.672
78
.670
79
.669
80
.667
81
.661
82
.661
83
.660
84
.660
85
.659
86
.657
87
.656
88
.656
89
.656
90
.656
91
.655
92
.654
93
.654
94
.654
95
.654
96
.652
97
.652
98
.651
99
.651
100
.650
101
.650
102
.649
103
.645
104
.645
105
.645
106
.645
107
.644
108
.642
109
.642
110
.642
111
.642
112
.641
113
.641
114
.637
115
.636
116
.636
117
.634
118
.634
119
.634
120
.632
121
.631
122
.631
123
.631
124
.631
125
.630
126
.630
127
.630
128
.627
129
.626
130
.626
131
.626
132
.625
133
.625
134
.625
135
.621
136
.620
137
.618
138
.616
139
.615
140
.615
141
.614
142
.614
143
.614
144
.613
145
.611
146
.610
147
.610
148
.609
149
.609
150
.608
151
.606
152
.606
153
.604
154
.604
155
.604
156
.604
157
.604
158
.603
159
.601
160
.601
161
.601
162
.601
163
.600
164
.600
165
.599
166
.599
167
.598
168
.596
169
.596
170
.596
171
.596
172
.596
173
.596
174
.595
175
.595
176
.595
177
.595
178
.594
179
.594
180
.593
181
.591
182
.590
183
.588
184
.585
185
.583
186
.583
187
.583
188
.583
189
.580
190
.580
191
.574
192
.573
193
.573
194
.571
195
.562
196
.562
197
.562
198
.561
199
.560
200
.560
201
.559
202
.557
203
.557
204
.554
205
.549
206
.547
207
.547
208
.546
209
.546
210
.546
211
.545
212
.544
213
.542
214
.542
215
.540
216
.540
217
.535
218
.532
219
.531
220
.531
221
.529
222
.526
223
.525
224
.524
225
.522
226
.522
227
.521
228
.520
229
.520
230
.519
231
.517
232
.514
233
.514
234
.511
235
.510
236
.509
237
.506
238
.505
239
.505
240
.502
241
.499
242
.499
243
.487
244
.485
245
.485
246
.480
247
.479
248
.472
249
.466
250
.461
251
.461
252
.456
253
.456
254
.455
255
.455
256
.450
257
.450
258
.450
259
.450
260
.450
261
.449
262
.444
263
.438
264
.431
265
.419
266
.410
267
.380
268
.379
269
.364
270
.351
271
.340
272
.334
273
.323
274
.319
275
.281
276
.156
277
.085
278
.083
279
.080
280
.076
281
.076
282
.075
283
.072
284
.065
285
.064
286
.064
287
.062
288
.062
289
.062
290
.062
291
.062
292
.062
293
.062
294
.061
295
.061
296
.061
297
.061
298
.059
299
.056
300
.056
301
.051
302
.046
303
.035
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021sketch

Metric: top1