Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonI-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.654
2
.637
3
.635
4
.630
5
.630
6
.627
7
.625
8
.625
9
.625
10
.625
11
.625
12
.618
13
.614
14
.613
15
.606
16
.606
17
.606
18
.604
19
.603
20
.603
21
.603
22
.603
23
.601
24
.596
25
.595
26
.591
27
.590
28
.588
29
.585
30
.584
31
.583
32
.583
33
.581
34
.579
35
.578
36
.578
37
.576
38
.575
39
.575
40
.575
41
.575
42
.575
43
.573
44
.571
45
.570
46
.566
47
.565
48
.565
49
.564
50
.562
51
.560
52
.559
53
.559
54
.557
55
.557
56
.556
57
.556
58
.555
59
.552
60
.551
61
.550
62
.550
63
.549
64
.547
65
.547
66
.546
67
.546
68
.546
69
.545
70
.544
71
.542
72
.542
73
.541
74
.541
75
.539
76
.537
77
.537
78
.537
79
.536
80
.536
81
.536
82
.536
83
.535
84
.535
85
.535
86
.535
87
.534
88
.534
89
.534
90
.534
91
.534
92
.534
93
.532
94
.532
95
.530
96
.529
97
.529
98
.529
99
.527
100
.527
101
.527
102
.527
103
.526
104
.526
105
.526
106
.526
107
.524
108
.522
109
.522
110
.522
111
.521
112
.521
113
.520
114
.520
115
.520
116
.520
117
.520
118
.519
119
.519
120
.519
121
.519
122
.519
123
.519
124
.517
125
.517
126
.517
127
.516
128
.516
129
.516
130
.516
131
.516
132
.515
133
.515
134
.515
135
.515
136
.515
137
.515
138
.515
139
.515
140
.515
141
.514
142
.514
143
.514
144
.512
145
.512
146
.512
147
.511
148
.510
149
.510
150
.510
151
.510
152
.510
153
.509
154
.507
155
.507
156
.506
157
.505
158
.505
159
.505
160
.504
161
.504
162
.502
163
.502
164
.502
165
.501
166
.501
167
.500
168
.500
169
.499
170
.499
171
.499
172
.497
173
.497
174
.497
175
.497
176
.496
177
.496
178
.495
179
.495
180
.495
181
.494
182
.494
183
.494
184
.492
185
.492
186
.491
187
.490
188
.490
189
.490
190
.489
191
.489
192
.489
193
.487
194
.486
195
.486
196
.485
197
.485
198
.484
199
.482
200
.482
201
.481
202
.481
203
.481
204
.479
205
.477
206
.477
207
.477
208
.477
209
.477
210
.477
211
.477
212
.477
213
.476
214
.476
215
.476
216
.475
217
.475
218
.474
219
.474
220
.474
221
.474
222
.474
223
.474
224
.474
225
.472
226
.471
227
.471
228
.471
229
.471
230
.470
231
.470
232
.469
233
.469
234
.469
235
.468
236
.468
237
.466
238
.465
239
.464
240
.464
241
.464
242
.464
243
.463
244
.463
245
.461
246
.461
247
.460
248
.460
249
.459
250
.458
251
.458
252
.456
253
.455
254
.454
255
.454
256
.453
257
.453
258
.453
259
.451
260
.450
261
.449
262
.449
263
.448
264
.448
265
.446
266
.445
267
.444
268
.444
269
.443
270
.439
271
.438
272
.434
273
.431
274
.430
275
.430
276
.426
277
.425
278
.425
279
.424
280
.422
281
.419
282
.412
283
.409
284
.404
285
.395
286
.393
287
.376
288
.359
289
.357
290
.280
291
.133
292
.106
293
.101
294
.085
295
.076
296
.075
297
.066
298
.062
299
.062
300
.062
301
.062
302
.062
303
.062
304
.062
305
.062
306
.062
307
.062
308
.062
309
.059
310
.059
311
.056
312
.054
313
.052
314
.051
315
.051
316
.050
317
.050
318
.048
319
.044
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonI

Metric: top1