Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonI-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.654
2
.637
3
.635
4
.630
5
.630
6
.627
7
.625
8
.625
9
.625
10
.625
11
.625
12
.618
13
.614
14
.613
15
.606
16
.606
17
.606
18
.604
19
.603
20
.603
21
.603
22
.603
23
.601
24
.596
25
.595
26
.591
27
.590
28
.588
29
.585
30
.584
31
.583
32
.583
33
.581
34
.579
35
.578
36
.578
37
.576
38
.575
39
.575
40
.575
41
.575
42
.575
43
.571
44
.570
45
.566
46
.565
47
.565
48
.564
49
.562
50
.560
51
.559
52
.559
53
.557
54
.557
55
.556
56
.556
57
.555
58
.552
59
.551
60
.550
61
.550
62
.549
63
.547
64
.547
65
.546
66
.546
67
.546
68
.545
69
.544
70
.542
71
.542
72
.541
73
.541
74
.539
75
.537
76
.537
77
.537
78
.536
79
.536
80
.536
81
.535
82
.535
83
.535
84
.535
85
.534
86
.534
87
.534
88
.534
89
.534
90
.532
91
.532
92
.530
93
.529
94
.529
95
.529
96
.527
97
.527
98
.527
99
.527
100
.526
101
.526
102
.526
103
.526
104
.524
105
.522
106
.522
107
.522
108
.521
109
.521
110
.520
111
.520
112
.520
113
.520
114
.519
115
.519
116
.519
117
.519
118
.519
119
.517
120
.517
121
.516
122
.516
123
.516
124
.516
125
.516
126
.515
127
.515
128
.515
129
.515
130
.515
131
.515
132
.515
133
.515
134
.515
135
.514
136
.514
137
.514
138
.512
139
.512
140
.512
141
.511
142
.510
143
.510
144
.510
145
.510
146
.510
147
.509
148
.507
149
.507
150
.506
151
.505
152
.505
153
.505
154
.504
155
.502
156
.502
157
.501
158
.501
159
.500
160
.500
161
.499
162
.499
163
.499
164
.497
165
.497
166
.497
167
.497
168
.496
169
.496
170
.495
171
.495
172
.495
173
.494
174
.494
175
.494
176
.492
177
.492
178
.491
179
.490
180
.490
181
.490
182
.489
183
.489
184
.487
185
.486
186
.486
187
.485
188
.485
189
.484
190
.482
191
.482
192
.481
193
.481
194
.481
195
.479
196
.477
197
.477
198
.477
199
.476
200
.476
201
.476
202
.475
203
.475
204
.474
205
.474
206
.474
207
.474
208
.474
209
.474
210
.474
211
.472
212
.471
213
.471
214
.471
215
.471
216
.470
217
.470
218
.469
219
.469
220
.469
221
.468
222
.468
223
.466
224
.465
225
.464
226
.464
227
.464
228
.464
229
.463
230
.463
231
.461
232
.461
233
.460
234
.460
235
.459
236
.458
237
.458
238
.456
239
.455
240
.454
241
.454
242
.453
243
.453
244
.453
245
.451
246
.450
247
.449
248
.449
249
.448
250
.448
251
.446
252
.445
253
.444
254
.444
255
.443
256
.439
257
.438
258
.434
259
.431
260
.430
261
.430
262
.426
263
.425
264
.425
265
.424
266
.422
267
.419
268
.412
269
.409
270
.404
271
.395
272
.393
273
.376
274
.359
275
.357
276
.280
277
.133
278
.106
279
.101
280
.085
281
.076
282
.075
283
.066
284
.062
285
.062
286
.062
287
.062
288
.062
289
.062
290
.062
291
.062
292
.062
293
.062
294
.062
295
.059
296
.059
297
.056
298
.054
299
.052
300
.051
301
.051
302
.050
303
.050
304
.048
305
.044
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonI

Metric: top1