Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonII-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.683
2
.675
3
.667
4
.656
5
.648
6
.647
7
.647
8
.644
9
.637
10
.636
11
.634
12
.634
13
.631
14
.622
15
.620
16
.620
17
.617
18
.616
19
.616
20
.613
21
.608
22
.605
23
.602
24
.602
25
.600
26
.600
27
.600
28
.600
29
.597
30
.597
31
.597
32
.597
33
.595
34
.594
35
.594
36
.592
37
.592
38
.589
39
.584
40
.581
41
.581
42
.580
43
.580
44
.578
45
.578
46
.578
47
.577
48
.577
49
.577
50
.577
51
.573
52
.573
53
.572
54
.570
55
.570
56
.570
57
.569
58
.569
59
.567
60
.567
61
.567
62
.567
63
.566
64
.566
65
.564
66
.562
67
.562
68
.561
69
.559
70
.559
71
.559
72
.559
73
.558
74
.558
75
.558
76
.558
77
.558
78
.556
79
.556
80
.555
81
.555
82
.555
83
.553
84
.552
85
.552
86
.552
87
.552
88
.552
89
.550
90
.550
91
.548
92
.548
93
.547
94
.547
95
.545
96
.545
97
.545
98
.544
99
.542
100
.542
101
.541
102
.541
103
.539
104
.539
105
.539
106
.539
107
.539
108
.539
109
.537
110
.537
111
.537
112
.537
113
.536
114
.536
115
.534
116
.534
117
.534
118
.534
119
.533
120
.533
121
.531
122
.531
123
.531
124
.531
125
.530
126
.530
127
.528
128
.528
129
.528
130
.528
131
.527
132
.523
133
.522
134
.520
135
.520
136
.519
137
.517
138
.517
139
.517
140
.516
141
.516
142
.514
143
.514
144
.514
145
.512
146
.512
147
.511
148
.511
149
.511
150
.509
151
.508
152
.506
153
.506
154
.506
155
.505
156
.505
157
.505
158
.503
159
.502
160
.502
161
.500
162
.498
163
.498
164
.497
165
.497
166
.495
167
.495
168
.494
169
.492
170
.492
171
.489
172
.489
173
.487
174
.487
175
.486
176
.486
177
.486
178
.486
179
.483
180
.483
181
.481
182
.481
183
.481
184
.480
185
.480
186
.478
187
.477
188
.475
189
.475
190
.475
191
.475
192
.473
193
.473
194
.473
195
.473
196
.470
197
.469
198
.467
199
.467
200
.467
201
.464
202
.464
203
.464
204
.463
205
.463
206
.461
207
.459
208
.459
209
.458
210
.456
211
.456
212
.455
213
.455
214
.455
215
.453
216
.453
217
.452
218
.450
219
.448
220
.448
221
.448
222
.448
223
.448
224
.448
225
.447
226
.447
227
.441
228
.441
229
.434
230
.434
231
.433
232
.431
233
.430
234
.430
235
.428
236
.425
237
.423
238
.420
239
.420
240
.419
241
.416
242
.408
243
.405
244
.405
245
.405
246
.395
247
.381
248
.353
249
.336
250
.280
251
.128
252
.117
253
.116
254
.084
255
.080
256
.077
257
.077
258
.073
259
.073
260
.067
261
.064
262
.064
263
.062
264
.062
265
.062
266
.062
267
.062
268
.062
269
.062
270
.062
271
.062
272
.062
273
.062
274
.062
275
.062
276
.062
277
.061
278
.059
279
.059
280
.052
281
.045
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonII

Metric: top1