Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021sketch-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.974
2
.958
3
.951
4
.946
5
.946
6
.945
7
.940
8
.935
9
.927
10
.925
11
.911
12
.909
13
.905
14
.902
15
.902
16
.897
17
.884
18
.879
19
.873
20
.871
21
.869
22
.864
23
.850
24
.833
25
.824
26
.806
27
.799
28
.795
29
.787
30
.784
31
.779
32
.779
33
.767
34
.766
35
.765
36
.760
37
.756
38
.740
39
.736
40
.736
41
.731
42
.730
43
.728
44
.721
45
.719
46
.713
47
.713
48
.706
49
.695
50
.689
51
.686
52
.682
53
.681
54
.681
55
.680
56
.680
57
.680
58
.680
59
.677
60
.677
61
.677
62
.676
63
.675
64
.674
65
.672
66
.672
67
.671
68
.670
69
.670
70
.669
71
.667
72
.661
73
.660
74
.660
75
.660
76
.659
77
.657
78
.656
79
.656
80
.656
81
.656
82
.655
83
.654
84
.654
85
.654
86
.654
87
.652
88
.652
89
.651
90
.651
91
.650
92
.650
93
.650
94
.650
95
.649
96
.649
97
.646
98
.645
99
.645
100
.645
101
.645
102
.644
103
.642
104
.642
105
.642
106
.642
107
.641
108
.641
109
.637
110
.636
111
.636
112
.635
113
.634
114
.634
115
.634
116
.632
117
.631
118
.631
119
.631
120
.631
121
.630
122
.630
123
.630
124
.627
125
.626
126
.626
127
.626
128
.625
129
.625
130
.625
131
.621
132
.620
133
.618
134
.616
135
.615
136
.615
137
.614
138
.614
139
.614
140
.613
141
.611
142
.610
143
.610
144
.609
145
.609
146
.608
147
.606
148
.606
149
.604
150
.604
151
.604
152
.604
153
.604
154
.603
155
.601
156
.601
157
.601
158
.601
159
.600
160
.600
161
.599
162
.599
163
.598
164
.596
165
.596
166
.596
167
.596
168
.596
169
.596
170
.595
171
.595
172
.595
173
.595
174
.594
175
.594
176
.593
177
.591
178
.590
179
.588
180
.585
181
.583
182
.583
183
.583
184
.583
185
.580
186
.580
187
.574
188
.573
189
.573
190
.571
191
.562
192
.562
193
.562
194
.561
195
.560
196
.560
197
.559
198
.557
199
.557
200
.554
201
.549
202
.547
203
.547
204
.546
205
.546
206
.546
207
.545
208
.544
209
.542
210
.542
211
.540
212
.540
213
.535
214
.532
215
.531
216
.531
217
.529
218
.526
219
.525
220
.524
221
.522
222
.522
223
.521
224
.520
225
.520
226
.519
227
.517
228
.514
229
.514
230
.511
231
.510
232
.509
233
.506
234
.505
235
.505
236
.502
237
.499
238
.499
239
.487
240
.485
241
.485
242
.480
243
.479
244
.472
245
.466
246
.461
247
.461
248
.456
249
.456
250
.455
251
.455
252
.450
253
.450
254
.450
255
.450
256
.450
257
.449
258
.444
259
.438
260
.431
261
.419
262
.410
263
.380
264
.379
265
.364
266
.351
267
.340
268
.334
269
.323
270
.319
271
.281
272
.156
273
.085
274
.083
275
.080
276
.076
277
.076
278
.075
279
.072
280
.066
281
.065
282
.064
283
.064
284
.062
285
.062
286
.062
287
.062
288
.062
289
.062
290
.062
291
.062
292
.061
293
.061
294
.061
295
.061
296
.059
297
.056
298
.056
299
.051
300
.046
301
.035
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021sketch

Metric: top1