Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021silhouette-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.800
2
.756
3
.731
4
.725
5
.719
6
.719
7
.719
8
.713
9
.706
10
.700
11
.694
12
.669
13
.662
14
.662
15
.656
16
.656
17
.656
18
.650
19
.650
20
.644
21
.637
22
.637
23
.631
24
.631
25
.631
26
.631
27
.625
28
.625
29
.613
30
.613
31
.606
32
.606
33
.606
34
.600
35
.600
36
.600
37
.600
38
.600
39
.600
40
.600
41
.600
42
.600
43
.600
44
.594
45
.588
46
.588
47
.581
48
.581
49
.575
50
.575
51
.575
52
.569
53
.569
54
.569
55
.562
56
.562
57
.562
58
.562
59
.562
60
.562
61
.556
62
.556
63
.556
64
.556
65
.550
66
.550
67
.550
68
.550
69
.550
70
.550
71
.550
72
.550
73
.550
74
.550
75
.550
76
.550
77
.544
78
.544
79
.544
80
.544
81
.544
82
.544
83
.544
84
.544
85
.544
86
.544
87
.544
88
.537
89
.537
90
.537
91
.537
92
.537
93
.537
94
.537
95
.531
96
.531
97
.531
98
.525
99
.525
100
.525
101
.525
102
.525
103
.525
104
.525
105
.525
106
.519
107
.519
108
.519
109
.519
110
.519
111
.519
112
.519
113
.519
114
.519
115
.519
116
.519
117
.512
118
.512
119
.512
120
.512
121
.512
122
.512
123
.512
124
.512
125
.506
126
.506
127
.506
128
.506
129
.506
130
.506
131
.506
132
.506
133
.500
134
.500
135
.494
136
.494
137
.494
138
.494
139
.494
140
.487
141
.487
142
.487
143
.487
144
.487
145
.481
146
.481
147
.481
148
.481
149
.481
150
.481
151
.481
152
.481
153
.475
154
.475
155
.475
156
.475
157
.475
158
.475
159
.469
160
.469
161
.463
162
.463
163
.463
164
.456
165
.456
166
.456
167
.450
168
.450
169
.450
170
.450
171
.450
172
.450
173
.450
174
.450
175
.450
176
.450
177
.444
178
.444
179
.438
180
.438
181
.438
182
.431
183
.431
184
.431
185
.431
186
.431
187
.431
188
.431
189
.431
190
.431
191
.431
192
.431
193
.431
194
.431
195
.431
196
.431
197
.431
198
.431
199
.431
200
.425
201
.419
202
.419
203
.412
204
.412
205
.412
206
.406
207
.400
208
.400
209
.400
210
.400
211
.394
212
.394
213
.394
214
.394
215
.388
216
.381
217
.381
218
.375
219
.375
220
.375
221
.375
222
.369
223
.369
224
.369
225
.369
226
.362
227
.362
228
.356
229
.356
230
.350
231
.344
232
.344
233
.344
234
.338
235
.338
236
.338
237
.331
238
.331
239
.331
240
.325
241
.325
242
.325
243
.319
244
.319
245
.306
246
.294
247
.294
248
.287
249
.263
250
.263
251
.250
252
.244
253
.237
254
.219
255
.156
256
.125
257
.125
258
.119
259
.113
260
.113
261
.106
262
.094
263
.087
264
.081
265
.081
266
.075
267
.075
268
.062
269
.062
270
.062
271
.062
272
.062
273
.062
274
.062
275
.062
276
.062
277
.062
278
.062
279
.062
280
.062
281
.056
282
.056
283
.056
284
.050
285
.044
286
.037
287
.006
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021silhouette

Metric: top1