Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021silhouette-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.800
2
.756
3
.731
4
.725
5
.719
6
.719
7
.719
8
.713
9
.706
10
.700
11
.694
12
.669
13
.662
14
.662
15
.656
16
.656
17
.656
18
.650
19
.650
20
.644
21
.637
22
.637
23
.631
24
.631
25
.631
26
.631
27
.625
28
.625
29
.613
30
.613
31
.606
32
.606
33
.606
34
.600
35
.600
36
.600
37
.600
38
.600
39
.600
40
.600
41
.600
42
.600
43
.600
44
.594
45
.588
46
.588
47
.581
48
.581
49
.575
50
.575
51
.575
52
.569
53
.569
54
.562
55
.562
56
.562
57
.562
58
.562
59
.562
60
.556
61
.556
62
.556
63
.556
64
.550
65
.550
66
.550
67
.550
68
.550
69
.550
70
.550
71
.550
72
.550
73
.550
74
.550
75
.550
76
.544
77
.544
78
.544
79
.544
80
.544
81
.544
82
.544
83
.544
84
.544
85
.544
86
.544
87
.537
88
.537
89
.537
90
.537
91
.537
92
.537
93
.537
94
.531
95
.531
96
.531
97
.525
98
.525
99
.525
100
.525
101
.525
102
.525
103
.525
104
.525
105
.519
106
.519
107
.519
108
.519
109
.519
110
.519
111
.519
112
.519
113
.519
114
.519
115
.519
116
.512
117
.512
118
.512
119
.512
120
.512
121
.512
122
.512
123
.512
124
.506
125
.506
126
.506
127
.506
128
.506
129
.506
130
.506
131
.506
132
.500
133
.500
134
.494
135
.494
136
.494
137
.494
138
.494
139
.487
140
.487
141
.487
142
.487
143
.487
144
.481
145
.481
146
.481
147
.481
148
.481
149
.475
150
.475
151
.475
152
.475
153
.475
154
.475
155
.469
156
.469
157
.463
158
.463
159
.463
160
.456
161
.456
162
.456
163
.450
164
.450
165
.450
166
.450
167
.450
168
.450
169
.450
170
.450
171
.450
172
.450
173
.444
174
.444
175
.438
176
.438
177
.438
178
.431
179
.431
180
.431
181
.431
182
.431
183
.431
184
.431
185
.431
186
.431
187
.431
188
.431
189
.431
190
.431
191
.431
192
.425
193
.419
194
.419
195
.412
196
.412
197
.412
198
.406
199
.400
200
.400
201
.400
202
.400
203
.394
204
.394
205
.394
206
.394
207
.388
208
.381
209
.381
210
.375
211
.375
212
.375
213
.375
214
.369
215
.369
216
.369
217
.369
218
.362
219
.362
220
.356
221
.356
222
.350
223
.344
224
.344
225
.344
226
.338
227
.338
228
.338
229
.331
230
.331
231
.331
232
.325
233
.325
234
.325
235
.319
236
.319
237
.306
238
.294
239
.294
240
.287
241
.263
242
.263
243
.250
244
.244
245
.237
246
.219
247
.156
248
.125
249
.125
250
.119
251
.113
252
.113
253
.106
254
.094
255
.087
256
.081
257
.081
258
.075
259
.075
260
.062
261
.062
262
.062
263
.062
264
.062
265
.062
266
.062
267
.062
268
.062
269
.062
270
.056
271
.056
272
.056
273
.050
274
.044
275
.037
276
.006
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021silhouette

Metric: top1