Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonIII-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.758
2
.733
3
.731
4
.717
5
.715
6
.715
7
.715
8
.715
9
.708
10
.700
11
.696
12
.692
13
.688
14
.683
15
.683
16
.683
17
.679
18
.665
19
.665
20
.662
21
.662
22
.658
23
.654
24
.654
25
.652
26
.646
27
.646
28
.637
29
.635
30
.635
31
.633
32
.633
33
.631
34
.627
35
.627
36
.627
37
.625
38
.625
39
.625
40
.623
41
.623
42
.619
43
.619
44
.619
45
.613
46
.613
47
.610
48
.608
49
.608
50
.608
51
.606
52
.604
53
.602
54
.602
55
.596
56
.596
57
.596
58
.596
59
.596
60
.594
61
.594
62
.590
63
.590
64
.590
65
.588
66
.585
67
.585
68
.585
69
.585
70
.585
71
.585
72
.583
73
.581
74
.581
75
.579
76
.577
77
.575
78
.573
79
.573
80
.573
81
.571
82
.571
83
.569
84
.569
85
.567
86
.565
87
.565
88
.560
89
.558
90
.558
91
.558
92
.558
93
.556
94
.556
95
.556
96
.556
97
.554
98
.554
99
.552
100
.552
101
.552
102
.550
103
.550
104
.550
105
.550
106
.550
107
.550
108
.550
109
.550
110
.550
111
.550
112
.548
113
.548
114
.546
115
.546
116
.542
117
.542
118
.540
119
.540
120
.540
121
.540
122
.540
123
.537
124
.535
125
.535
126
.533
127
.531
128
.529
129
.527
130
.527
131
.527
132
.527
133
.525
134
.523
135
.523
136
.521
137
.521
138
.521
139
.519
140
.519
141
.517
142
.515
143
.515
144
.515
145
.512
146
.512
147
.510
148
.508
149
.506
150
.506
151
.504
152
.504
153
.502
154
.502
155
.502
156
.502
157
.500
158
.500
159
.500
160
.498
161
.498
162
.498
163
.498
164
.496
165
.496
166
.494
167
.492
168
.492
169
.490
170
.490
171
.490
172
.487
173
.485
174
.483
175
.483
176
.483
177
.481
178
.477
179
.475
180
.475
181
.475
182
.475
183
.473
184
.471
185
.471
186
.469
187
.469
188
.469
189
.469
190
.469
191
.469
192
.469
193
.467
194
.467
195
.463
196
.463
197
.463
198
.463
199
.463
200
.460
201
.460
202
.458
203
.458
204
.456
205
.456
206
.452
207
.452
208
.450
209
.448
210
.446
211
.444
212
.442
213
.438
214
.438
215
.438
216
.438
217
.438
218
.438
219
.438
220
.438
221
.438
222
.438
223
.435
224
.435
225
.435
226
.433
227
.425
228
.423
229
.423
230
.421
231
.417
232
.417
233
.412
234
.410
235
.408
236
.406
237
.406
238
.404
239
.404
240
.400
241
.396
242
.396
243
.392
244
.390
245
.373
246
.358
247
.327
248
.219
249
.117
250
.106
251
.094
252
.087
253
.081
254
.069
255
.067
256
.067
257
.062
258
.062
259
.062
260
.062
261
.062
262
.062
263
.062
264
.062
265
.062
266
.062
267
.062
268
.062
269
.060
270
.060
271
.060
272
.054
273
.052
274
.048
275
.046
276
.029
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonIII

Metric: top1