Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021silhouette-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.800
2
.794
3
.756
4
.731
5
.731
6
.725
7
.719
8
.719
9
.719
10
.719
11
.713
12
.713
13
.713
14
.706
15
.700
16
.700
17
.694
18
.694
19
.688
20
.688
21
.681
22
.681
23
.669
24
.662
25
.662
26
.662
27
.656
28
.656
29
.656
30
.650
31
.650
32
.650
33
.644
34
.637
35
.637
36
.637
37
.631
38
.631
39
.631
40
.631
41
.625
42
.625
43
.613
44
.613
45
.613
46
.606
47
.606
48
.606
49
.600
50
.600
51
.600
52
.600
53
.600
54
.600
55
.600
56
.600
57
.600
58
.600
59
.594
60
.594
61
.588
62
.588
63
.581
64
.581
65
.581
66
.575
67
.575
68
.575
69
.569
70
.569
71
.569
72
.569
73
.562
74
.562
75
.562
76
.562
77
.562
78
.562
79
.556
80
.556
81
.556
82
.556
83
.550
84
.550
85
.550
86
.550
87
.550
88
.550
89
.550
90
.550
91
.550
92
.550
93
.550
94
.550
95
.544
96
.544
97
.544
98
.544
99
.544
100
.544
101
.544
102
.544
103
.544
104
.544
105
.544
106
.544
107
.544
108
.544
109
.537
110
.537
111
.537
112
.537
113
.537
114
.537
115
.537
116
.531
117
.531
118
.531
119
.525
120
.525
121
.525
122
.525
123
.525
124
.525
125
.525
126
.525
127
.525
128
.525
129
.519
130
.519
131
.519
132
.519
133
.519
134
.519
135
.519
136
.519
137
.519
138
.519
139
.519
140
.519
141
.519
142
.512
143
.512
144
.512
145
.512
146
.512
147
.512
148
.512
149
.512
150
.512
151
.506
152
.506
153
.506
154
.506
155
.506
156
.506
157
.506
158
.506
159
.500
160
.500
161
.494
162
.494
163
.494
164
.494
165
.494
166
.487
167
.487
168
.487
169
.487
170
.487
171
.481
172
.481
173
.481
174
.481
175
.481
176
.481
177
.481
178
.481
179
.481
180
.481
181
.481
182
.481
183
.475
184
.475
185
.475
186
.475
187
.475
188
.475
189
.475
190
.469
191
.469
192
.463
193
.463
194
.463
195
.463
196
.463
197
.456
198
.456
199
.456
200
.450
201
.450
202
.450
203
.450
204
.450
205
.450
206
.450
207
.450
208
.450
209
.450
210
.450
211
.444
212
.444
213
.444
214
.438
215
.438
216
.438
217
.431
218
.431
219
.431
220
.431
221
.431
222
.431
223
.431
224
.431
225
.431
226
.431
227
.431
228
.425
229
.419
230
.419
231
.412
232
.412
233
.412
234
.412
235
.406
236
.406
237
.400
238
.400
239
.400
240
.400
241
.394
242
.394
243
.394
244
.394
245
.394
246
.394
247
.388
248
.388
249
.381
250
.375
251
.375
252
.375
253
.375
254
.375
255
.369
256
.369
257
.369
258
.369
259
.369
260
.362
261
.362
262
.356
263
.356
264
.350
265
.344
266
.344
267
.344
268
.344
269
.338
270
.338
271
.338
272
.331
273
.331
274
.331
275
.325
276
.325
277
.325
278
.319
279
.319
280
.306
281
.294
282
.294
283
.287
284
.275
285
.263
286
.263
287
.250
288
.244
289
.237
290
.219
291
.156
292
.125
293
.125
294
.119
295
.113
296
.113
297
.106
298
.087
299
.081
300
.081
301
.075
302
.075
303
.062
304
.062
305
.062
306
.062
307
.062
308
.062
309
.062
310
.062
311
.062
312
.062
313
.062
314
.062
315
.056
316
.056
317
.056
318
.050
319
.044
320
.037
321
.006
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021silhouette

Metric: top1