Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021sketch-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.974
2
.958
3
.951
4
.946
5
.946
6
.945
7
.940
8
.935
9
.927
10
.925
11
.911
12
.909
13
.905
14
.902
15
.902
16
.897
17
.884
18
.879
19
.873
20
.871
21
.869
22
.850
23
.824
24
.806
25
.795
26
.787
27
.779
28
.779
29
.767
30
.766
31
.765
32
.760
33
.756
34
.740
35
.736
36
.736
37
.731
38
.730
39
.728
40
.721
41
.719
42
.713
43
.713
44
.706
45
.695
46
.689
47
.686
48
.682
49
.681
50
.681
51
.680
52
.680
53
.680
54
.677
55
.677
56
.677
57
.676
58
.675
59
.674
60
.672
61
.672
62
.670
63
.667
64
.661
65
.660
66
.660
67
.657
68
.656
69
.656
70
.656
71
.656
72
.655
73
.654
74
.654
75
.654
76
.654
77
.652
78
.652
79
.651
80
.650
81
.650
82
.649
83
.645
84
.645
85
.645
86
.644
87
.642
88
.642
89
.642
90
.642
91
.641
92
.641
93
.637
94
.636
95
.634
96
.634
97
.634
98
.632
99
.631
100
.631
101
.631
102
.631
103
.630
104
.630
105
.630
106
.627
107
.626
108
.626
109
.626
110
.625
111
.625
112
.621
113
.620
114
.618
115
.616
116
.615
117
.615
118
.614
119
.614
120
.614
121
.613
122
.611
123
.610
124
.610
125
.609
126
.609
127
.608
128
.606
129
.606
130
.604
131
.604
132
.604
133
.604
134
.604
135
.603
136
.601
137
.601
138
.601
139
.601
140
.600
141
.600
142
.599
143
.599
144
.598
145
.596
146
.596
147
.596
148
.596
149
.596
150
.596
151
.595
152
.595
153
.595
154
.595
155
.594
156
.594
157
.593
158
.591
159
.590
160
.588
161
.585
162
.583
163
.583
164
.583
165
.583
166
.580
167
.580
168
.574
169
.573
170
.573
171
.571
172
.562
173
.562
174
.562
175
.561
176
.560
177
.560
178
.559
179
.557
180
.557
181
.549
182
.547
183
.547
184
.546
185
.546
186
.546
187
.545
188
.542
189
.542
190
.540
191
.540
192
.535
193
.532
194
.531
195
.531
196
.529
197
.526
198
.525
199
.524
200
.522
201
.522
202
.521
203
.520
204
.520
205
.519
206
.517
207
.514
208
.514
209
.511
210
.510
211
.509
212
.506
213
.505
214
.505
215
.502
216
.499
217
.499
218
.487
219
.485
220
.485
221
.480
222
.479
223
.472
224
.466
225
.461
226
.461
227
.456
228
.456
229
.455
230
.455
231
.450
232
.450
233
.450
234
.450
235
.450
236
.449
237
.444
238
.438
239
.431
240
.419
241
.410
242
.380
243
.379
244
.364
245
.351
246
.340
247
.334
248
.323
249
.319
250
.281
251
.156
252
.085
253
.083
254
.080
255
.076
256
.076
257
.075
258
.072
259
.066
260
.065
261
.064
262
.064
263
.062
264
.062
265
.062
266
.062
267
.062
268
.062
269
.062
270
.062
271
.061
272
.061
273
.061
274
.061
275
.059
276
.056
277
.056
278
.051
279
.046
280
.035
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021sketch

Metric: top1