Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonII-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.722
2
.719
3
.708
4
.695
5
.683
6
.683
7
.675
8
.672
9
.667
10
.664
11
.656
12
.655
13
.650
14
.648
15
.647
16
.647
17
.647
18
.644
19
.637
20
.636
21
.634
22
.634
23
.634
24
.633
25
.633
26
.631
27
.622
28
.620
29
.620
30
.617
31
.616
32
.616
33
.616
34
.613
35
.608
36
.605
37
.602
38
.602
39
.602
40
.600
41
.600
42
.600
43
.600
44
.598
45
.597
46
.597
47
.597
48
.597
49
.595
50
.594
51
.594
52
.592
53
.592
54
.589
55
.588
56
.584
57
.581
58
.581
59
.580
60
.580
61
.578
62
.578
63
.578
64
.578
65
.577
66
.577
67
.577
68
.577
69
.573
70
.573
71
.572
72
.572
73
.570
74
.570
75
.570
76
.569
77
.569
78
.567
79
.567
80
.567
81
.567
82
.566
83
.566
84
.564
85
.564
86
.562
87
.562
88
.562
89
.561
90
.559
91
.559
92
.559
93
.559
94
.558
95
.558
96
.558
97
.558
98
.558
99
.556
100
.556
101
.555
102
.555
103
.555
104
.555
105
.553
106
.552
107
.552
108
.552
109
.552
110
.552
111
.550
112
.550
113
.548
114
.548
115
.547
116
.547
117
.547
118
.545
119
.545
120
.545
121
.544
122
.542
123
.542
124
.542
125
.542
126
.541
127
.541
128
.539
129
.539
130
.539
131
.539
132
.539
133
.539
134
.537
135
.537
136
.537
137
.537
138
.536
139
.536
140
.536
141
.534
142
.534
143
.534
144
.534
145
.533
146
.533
147
.531
148
.531
149
.531
150
.531
151
.530
152
.530
153
.530
154
.528
155
.528
156
.528
157
.528
158
.527
159
.523
160
.523
161
.523
162
.522
163
.520
164
.520
165
.519
166
.517
167
.517
168
.517
169
.516
170
.516
171
.516
172
.514
173
.514
174
.514
175
.512
176
.512
177
.511
178
.511
179
.511
180
.509
181
.508
182
.506
183
.506
184
.506
185
.505
186
.505
187
.505
188
.503
189
.502
190
.502
191
.500
192
.500
193
.498
194
.498
195
.498
196
.497
197
.497
198
.495
199
.495
200
.494
201
.492
202
.492
203
.489
204
.489
205
.487
206
.487
207
.486
208
.486
209
.486
210
.486
211
.486
212
.483
213
.483
214
.481
215
.481
216
.481
217
.480
218
.480
219
.480
220
.480
221
.478
222
.477
223
.477
224
.477
225
.477
226
.477
227
.475
228
.475
229
.475
230
.475
231
.473
232
.473
233
.473
234
.473
235
.473
236
.470
237
.470
238
.469
239
.467
240
.467
241
.467
242
.467
243
.466
244
.464
245
.464
246
.464
247
.463
248
.463
249
.461
250
.459
251
.459
252
.458
253
.456
254
.456
255
.455
256
.455
257
.455
258
.453
259
.453
260
.452
261
.450
262
.448
263
.448
264
.448
265
.448
266
.448
267
.448
268
.447
269
.447
270
.441
271
.441
272
.434
273
.434
274
.433
275
.431
276
.430
277
.430
278
.428
279
.425
280
.423
281
.420
282
.420
283
.419
284
.416
285
.409
286
.408
287
.405
288
.405
289
.405
290
.395
291
.381
292
.353
293
.336
294
.280
295
.128
296
.117
297
.116
298
.084
299
.080
300
.077
301
.077
302
.073
303
.073
304
.067
305
.064
306
.064
307
.062
308
.062
309
.062
310
.062
311
.062
312
.062
313
.062
314
.062
315
.062
316
.062
317
.062
318
.062
319
.062
320
.059
321
.059
322
.052
323
.045
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonII

Metric: top1