Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021sketch-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.974
2
.958
3
.951
4
.946
5
.946
6
.945
7
.940
8
.935
9
.927
10
.925
11
.911
12
.909
13
.905
14
.902
15
.902
16
.897
17
.884
18
.879
19
.873
20
.871
21
.869
22
.850
23
.824
24
.806
25
.795
26
.787
27
.779
28
.779
29
.767
30
.766
31
.765
32
.760
33
.756
34
.740
35
.736
36
.736
37
.731
38
.730
39
.728
40
.721
41
.719
42
.713
43
.713
44
.706
45
.695
46
.689
47
.686
48
.682
49
.681
50
.681
51
.680
52
.680
53
.680
54
.677
55
.677
56
.677
57
.676
58
.675
59
.672
60
.672
61
.670
62
.667
63
.661
64
.660
65
.660
66
.657
67
.656
68
.656
69
.656
70
.656
71
.655
72
.654
73
.654
74
.654
75
.654
76
.652
77
.652
78
.651
79
.650
80
.650
81
.649
82
.645
83
.645
84
.645
85
.644
86
.642
87
.641
88
.641
89
.637
90
.636
91
.634
92
.634
93
.634
94
.632
95
.631
96
.631
97
.631
98
.631
99
.630
100
.630
101
.630
102
.627
103
.626
104
.626
105
.626
106
.625
107
.625
108
.621
109
.620
110
.618
111
.616
112
.615
113
.615
114
.614
115
.614
116
.614
117
.613
118
.611
119
.610
120
.610
121
.609
122
.609
123
.608
124
.606
125
.606
126
.604
127
.604
128
.604
129
.604
130
.604
131
.603
132
.601
133
.601
134
.601
135
.601
136
.600
137
.600
138
.599
139
.599
140
.598
141
.596
142
.596
143
.596
144
.596
145
.596
146
.596
147
.595
148
.595
149
.595
150
.595
151
.594
152
.594
153
.593
154
.591
155
.590
156
.588
157
.585
158
.583
159
.583
160
.583
161
.583
162
.580
163
.580
164
.574
165
.573
166
.573
167
.571
168
.562
169
.562
170
.562
171
.561
172
.560
173
.560
174
.559
175
.557
176
.557
177
.549
178
.547
179
.547
180
.546
181
.546
182
.546
183
.545
184
.542
185
.542
186
.540
187
.540
188
.535
189
.532
190
.531
191
.531
192
.529
193
.526
194
.525
195
.524
196
.522
197
.522
198
.521
199
.520
200
.520
201
.519
202
.517
203
.514
204
.514
205
.511
206
.510
207
.509
208
.505
209
.505
210
.502
211
.499
212
.499
213
.487
214
.485
215
.485
216
.480
217
.479
218
.472
219
.466
220
.461
221
.461
222
.456
223
.456
224
.456
225
.455
226
.455
227
.450
228
.450
229
.450
230
.450
231
.450
232
.450
233
.450
234
.450
235
.450
236
.449
237
.444
238
.438
239
.431
240
.419
241
.410
242
.380
243
.379
244
.364
245
.351
246
.340
247
.334
248
.323
249
.319
250
.281
251
.156
252
.085
253
.083
254
.080
255
.076
256
.076
257
.075
258
.072
259
.066
260
.065
261
.064
262
.064
263
.062
264
.062
265
.062
266
.062
267
.062
268
.062
269
.062
270
.062
271
.061
272
.059
273
.056
274
.056
275
.051
276
.046
277
.035
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021sketch

Metric: top1