Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonI-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.654
2
.637
3
.630
4
.627
5
.625
6
.625
7
.625
8
.625
9
.625
10
.618
11
.613
12
.606
13
.606
14
.606
15
.603
16
.603
17
.603
18
.603
19
.601
20
.595
21
.590
22
.588
23
.585
24
.584
25
.583
26
.583
27
.581
28
.579
29
.578
30
.576
31
.575
32
.575
33
.575
34
.575
35
.571
36
.566
37
.565
38
.562
39
.560
40
.559
41
.559
42
.557
43
.557
44
.556
45
.556
46
.555
47
.552
48
.551
49
.550
50
.550
51
.549
52
.547
53
.547
54
.546
55
.546
56
.546
57
.545
58
.544
59
.542
60
.542
61
.541
62
.541
63
.539
64
.537
65
.537
66
.537
67
.536
68
.536
69
.535
70
.535
71
.535
72
.535
73
.534
74
.534
75
.534
76
.534
77
.534
78
.532
79
.532
80
.530
81
.529
82
.529
83
.529
84
.529
85
.527
86
.527
87
.527
88
.527
89
.526
90
.526
91
.526
92
.526
93
.526
94
.524
95
.522
96
.522
97
.522
98
.521
99
.521
100
.520
101
.520
102
.520
103
.520
104
.519
105
.519
106
.519
107
.519
108
.519
109
.517
110
.517
111
.516
112
.516
113
.516
114
.516
115
.516
116
.515
117
.515
118
.515
119
.515
120
.515
121
.515
122
.515
123
.515
124
.514
125
.514
126
.514
127
.512
128
.512
129
.512
130
.512
131
.512
132
.511
133
.511
134
.510
135
.510
136
.510
137
.510
138
.510
139
.509
140
.507
141
.507
142
.506
143
.505
144
.505
145
.505
146
.504
147
.504
148
.502
149
.502
150
.501
151
.501
152
.500
153
.500
154
.499
155
.499
156
.499
157
.497
158
.497
159
.497
160
.497
161
.496
162
.496
163
.495
164
.495
165
.495
166
.494
167
.494
168
.494
169
.494
170
.492
171
.492
172
.491
173
.490
174
.490
175
.490
176
.489
177
.489
178
.487
179
.486
180
.486
181
.485
182
.485
183
.484
184
.482
185
.482
186
.481
187
.481
188
.481
189
.479
190
.477
191
.477
192
.477
193
.476
194
.476
195
.476
196
.475
197
.475
198
.474
199
.474
200
.474
201
.474
202
.474
203
.474
204
.474
205
.472
206
.471
207
.471
208
.471
209
.471
210
.470
211
.470
212
.469
213
.469
214
.469
215
.468
216
.468
217
.466
218
.465
219
.464
220
.464
221
.464
222
.464
223
.464
224
.463
225
.463
226
.461
227
.461
228
.460
229
.460
230
.459
231
.458
232
.458
233
.455
234
.454
235
.454
236
.453
237
.453
238
.453
239
.451
240
.450
241
.449
242
.449
243
.448
244
.448
245
.446
246
.445
247
.444
248
.444
249
.443
250
.439
251
.438
252
.434
253
.431
254
.430
255
.430
256
.426
257
.425
258
.425
259
.424
260
.422
261
.419
262
.412
263
.409
264
.404
265
.395
266
.393
267
.376
268
.359
269
.357
270
.280
271
.133
272
.106
273
.101
274
.085
275
.076
276
.075
277
.066
278
.062
279
.062
280
.062
281
.062
282
.062
283
.062
284
.062
285
.062
286
.062
287
.062
288
.062
289
.062
290
.059
291
.059
292
.056
293
.054
294
.052
295
.051
296
.051
297
.051
298
.050
299
.050
300
.048
301
.044
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonI

Metric: top1