Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonIII-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.758
2
.733
3
.731
4
.717
5
.715
6
.715
7
.715
8
.715
9
.708
10
.700
11
.696
12
.692
13
.688
14
.683
15
.683
16
.683
17
.679
18
.665
19
.665
20
.662
21
.662
22
.658
23
.654
24
.654
25
.652
26
.646
27
.646
28
.637
29
.635
30
.635
31
.633
32
.633
33
.631
34
.627
35
.627
36
.627
37
.625
38
.625
39
.625
40
.623
41
.623
42
.619
43
.619
44
.619
45
.613
46
.613
47
.610
48
.608
49
.608
50
.608
51
.606
52
.604
53
.602
54
.602
55
.602
56
.602
57
.602
58
.596
59
.596
60
.596
61
.596
62
.596
63
.594
64
.594
65
.590
66
.590
67
.590
68
.588
69
.585
70
.585
71
.585
72
.585
73
.585
74
.585
75
.583
76
.581
77
.581
78
.579
79
.577
80
.575
81
.575
82
.573
83
.573
84
.573
85
.571
86
.571
87
.569
88
.569
89
.567
90
.565
91
.565
92
.560
93
.558
94
.558
95
.558
96
.558
97
.556
98
.556
99
.556
100
.556
101
.554
102
.554
103
.552
104
.552
105
.552
106
.550
107
.550
108
.550
109
.550
110
.550
111
.550
112
.550
113
.550
114
.550
115
.550
116
.548
117
.548
118
.546
119
.546
120
.542
121
.542
122
.540
123
.540
124
.540
125
.540
126
.540
127
.537
128
.535
129
.535
130
.533
131
.531
132
.529
133
.527
134
.527
135
.527
136
.527
137
.525
138
.523
139
.523
140
.521
141
.521
142
.521
143
.519
144
.519
145
.517
146
.515
147
.515
148
.515
149
.512
150
.512
151
.510
152
.508
153
.506
154
.506
155
.504
156
.504
157
.502
158
.502
159
.502
160
.502
161
.500
162
.500
163
.500
164
.498
165
.498
166
.498
167
.498
168
.496
169
.496
170
.494
171
.492
172
.492
173
.490
174
.490
175
.490
176
.487
177
.485
178
.483
179
.483
180
.483
181
.481
182
.477
183
.475
184
.475
185
.475
186
.475
187
.473
188
.471
189
.471
190
.469
191
.469
192
.469
193
.469
194
.469
195
.469
196
.469
197
.467
198
.467
199
.463
200
.463
201
.463
202
.463
203
.463
204
.460
205
.460
206
.458
207
.458
208
.456
209
.456
210
.452
211
.452
212
.450
213
.448
214
.446
215
.444
216
.442
217
.438
218
.438
219
.438
220
.438
221
.438
222
.438
223
.438
224
.438
225
.438
226
.438
227
.438
228
.438
229
.438
230
.438
231
.435
232
.435
233
.435
234
.433
235
.425
236
.423
237
.423
238
.421
239
.417
240
.417
241
.412
242
.410
243
.408
244
.406
245
.406
246
.404
247
.404
248
.400
249
.396
250
.396
251
.392
252
.390
253
.373
254
.358
255
.327
256
.219
257
.117
258
.106
259
.094
260
.087
261
.081
262
.069
263
.067
264
.067
265
.062
266
.062
267
.062
268
.062
269
.062
270
.062
271
.062
272
.062
273
.062
274
.062
275
.062
276
.062
277
.062
278
.062
279
.062
280
.060
281
.060
282
.060
283
.054
284
.052
285
.048
286
.046
287
.029
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonIII

Metric: top1