Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonII-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.683
2
.675
3
.667
4
.656
5
.648
6
.647
7
.647
8
.644
9
.637
10
.636
11
.634
12
.634
13
.631
14
.622
15
.620
16
.620
17
.617
18
.616
19
.616
20
.613
21
.608
22
.605
23
.602
24
.602
25
.600
26
.600
27
.600
28
.600
29
.597
30
.597
31
.597
32
.597
33
.595
34
.594
35
.594
36
.592
37
.592
38
.589
39
.584
40
.581
41
.581
42
.580
43
.580
44
.578
45
.578
46
.578
47
.577
48
.577
49
.577
50
.577
51
.573
52
.573
53
.572
54
.570
55
.570
56
.570
57
.569
58
.569
59
.567
60
.567
61
.567
62
.567
63
.566
64
.566
65
.564
66
.562
67
.562
68
.561
69
.559
70
.559
71
.559
72
.559
73
.558
74
.558
75
.558
76
.558
77
.558
78
.556
79
.556
80
.555
81
.555
82
.555
83
.553
84
.552
85
.552
86
.552
87
.552
88
.552
89
.550
90
.550
91
.548
92
.548
93
.547
94
.547
95
.545
96
.545
97
.545
98
.544
99
.542
100
.542
101
.541
102
.541
103
.539
104
.539
105
.539
106
.539
107
.539
108
.539
109
.537
110
.537
111
.537
112
.537
113
.536
114
.536
115
.534
116
.534
117
.534
118
.534
119
.533
120
.533
121
.531
122
.531
123
.531
124
.530
125
.530
126
.528
127
.528
128
.528
129
.528
130
.527
131
.523
132
.522
133
.520
134
.520
135
.519
136
.517
137
.517
138
.517
139
.516
140
.516
141
.514
142
.514
143
.514
144
.512
145
.512
146
.511
147
.511
148
.511
149
.509
150
.508
151
.506
152
.506
153
.506
154
.505
155
.505
156
.503
157
.502
158
.502
159
.500
160
.498
161
.498
162
.497
163
.497
164
.495
165
.495
166
.494
167
.492
168
.492
169
.489
170
.489
171
.487
172
.487
173
.486
174
.486
175
.486
176
.486
177
.483
178
.483
179
.481
180
.481
181
.481
182
.480
183
.480
184
.478
185
.477
186
.475
187
.475
188
.475
189
.475
190
.473
191
.473
192
.473
193
.473
194
.470
195
.469
196
.467
197
.467
198
.467
199
.464
200
.464
201
.464
202
.463
203
.463
204
.461
205
.459
206
.459
207
.458
208
.456
209
.456
210
.455
211
.455
212
.455
213
.453
214
.453
215
.452
216
.450
217
.448
218
.448
219
.448
220
.448
221
.448
222
.448
223
.448
224
.448
225
.448
226
.448
227
.448
228
.448
229
.448
230
.448
231
.447
232
.447
233
.441
234
.441
235
.434
236
.434
237
.433
238
.431
239
.430
240
.430
241
.428
242
.425
243
.423
244
.420
245
.420
246
.419
247
.416
248
.411
249
.408
250
.405
251
.405
252
.405
253
.395
254
.381
255
.353
256
.336
257
.280
258
.128
259
.117
260
.116
261
.084
262
.080
263
.077
264
.077
265
.073
266
.073
267
.067
268
.064
269
.064
270
.062
271
.062
272
.062
273
.062
274
.062
275
.062
276
.062
277
.062
278
.062
279
.062
280
.062
281
.062
282
.062
283
.062
284
.061
285
.059
286
.059
287
.052
288
.045
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonII

Metric: top1