Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonIII-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.758
2
.733
3
.731
4
.717
5
.715
6
.715
7
.715
8
.715
9
.708
10
.708
11
.700
12
.696
13
.692
14
.688
15
.688
16
.683
17
.683
18
.683
19
.679
20
.665
21
.665
22
.662
23
.662
24
.660
25
.658
26
.654
27
.654
28
.652
29
.646
30
.646
31
.637
32
.635
33
.635
34
.633
35
.633
36
.631
37
.627
38
.627
39
.627
40
.625
41
.625
42
.625
43
.623
44
.623
45
.619
46
.619
47
.619
48
.613
49
.613
50
.610
51
.608
52
.608
53
.608
54
.606
55
.604
56
.602
57
.602
58
.602
59
.602
60
.602
61
.596
62
.596
63
.596
64
.596
65
.596
66
.594
67
.594
68
.590
69
.590
70
.590
71
.588
72
.585
73
.585
74
.585
75
.585
76
.585
77
.585
78
.583
79
.581
80
.581
81
.579
82
.577
83
.575
84
.575
85
.573
86
.573
87
.573
88
.571
89
.571
90
.569
91
.569
92
.567
93
.567
94
.565
95
.565
96
.562
97
.560
98
.558
99
.558
100
.558
101
.558
102
.558
103
.556
104
.556
105
.556
106
.556
107
.554
108
.554
109
.554
110
.552
111
.552
112
.552
113
.550
114
.550
115
.550
116
.550
117
.550
118
.550
119
.550
120
.550
121
.550
122
.550
123
.548
124
.548
125
.548
126
.546
127
.546
128
.546
129
.544
130
.542
131
.542
132
.542
133
.542
134
.540
135
.540
136
.540
137
.540
138
.540
139
.537
140
.537
141
.535
142
.535
143
.533
144
.533
145
.531
146
.531
147
.529
148
.529
149
.527
150
.527
151
.527
152
.527
153
.525
154
.525
155
.523
156
.523
157
.523
158
.523
159
.521
160
.521
161
.521
162
.519
163
.519
164
.519
165
.517
166
.517
167
.515
168
.515
169
.515
170
.515
171
.512
172
.512
173
.510
174
.508
175
.506
176
.506
177
.506
178
.504
179
.504
180
.502
181
.502
182
.502
183
.502
184
.500
185
.500
186
.500
187
.498
188
.498
189
.498
190
.498
191
.498
192
.496
193
.496
194
.494
195
.492
196
.492
197
.490
198
.490
199
.490
200
.487
201
.485
202
.483
203
.483
204
.483
205
.481
206
.477
207
.475
208
.475
209
.475
210
.475
211
.473
212
.471
213
.471
214
.469
215
.469
216
.469
217
.469
218
.469
219
.469
220
.469
221
.467
222
.467
223
.463
224
.463
225
.463
226
.463
227
.463
228
.460
229
.460
230
.458
231
.458
232
.456
233
.456
234
.452
235
.452
236
.450
237
.448
238
.446
239
.444
240
.444
241
.442
242
.438
243
.438
244
.438
245
.438
246
.438
247
.438
248
.435
249
.435
250
.435
251
.433
252
.425
253
.423
254
.423
255
.421
256
.417
257
.417
258
.412
259
.408
260
.406
261
.406
262
.404
263
.404
264
.400
265
.396
266
.396
267
.392
268
.390
269
.373
270
.358
271
.327
272
.219
273
.117
274
.106
275
.094
276
.087
277
.081
278
.069
279
.067
280
.067
281
.062
282
.062
283
.062
284
.062
285
.062
286
.062
287
.062
288
.062
289
.062
290
.062
291
.062
292
.062
293
.062
294
.062
295
.062
296
.060
297
.060
298
.060
299
.054
300
.052
301
.048
302
.046
303
.029
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonIII

Metric: top1