Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonIII-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.758
2
.733
3
.731
4
.717
5
.715
6
.715
7
.715
8
.715
9
.708
10
.700
11
.696
12
.692
13
.688
14
.683
15
.683
16
.683
17
.679
18
.665
19
.665
20
.662
21
.662
22
.658
23
.654
24
.654
25
.652
26
.646
27
.646
28
.637
29
.635
30
.635
31
.633
32
.633
33
.631
34
.627
35
.627
36
.627
37
.625
38
.625
39
.625
40
.623
41
.623
42
.619
43
.619
44
.619
45
.613
46
.613
47
.610
48
.608
49
.608
50
.608
51
.606
52
.604
53
.602
54
.602
55
.596
56
.596
57
.596
58
.596
59
.596
60
.594
61
.594
62
.590
63
.590
64
.590
65
.588
66
.585
67
.585
68
.585
69
.585
70
.585
71
.585
72
.583
73
.581
74
.581
75
.579
76
.577
77
.575
78
.575
79
.573
80
.573
81
.573
82
.571
83
.571
84
.569
85
.569
86
.567
87
.565
88
.565
89
.560
90
.558
91
.558
92
.558
93
.558
94
.556
95
.556
96
.556
97
.556
98
.554
99
.554
100
.552
101
.552
102
.552
103
.550
104
.550
105
.550
106
.550
107
.550
108
.550
109
.550
110
.550
111
.550
112
.550
113
.548
114
.548
115
.546
116
.546
117
.542
118
.542
119
.540
120
.540
121
.540
122
.540
123
.540
124
.537
125
.535
126
.535
127
.533
128
.531
129
.529
130
.527
131
.527
132
.527
133
.527
134
.525
135
.523
136
.523
137
.521
138
.521
139
.521
140
.519
141
.519
142
.517
143
.515
144
.515
145
.515
146
.512
147
.512
148
.510
149
.508
150
.506
151
.506
152
.504
153
.504
154
.502
155
.502
156
.502
157
.502
158
.500
159
.500
160
.500
161
.498
162
.498
163
.498
164
.498
165
.496
166
.496
167
.494
168
.492
169
.492
170
.490
171
.490
172
.490
173
.487
174
.485
175
.483
176
.483
177
.483
178
.481
179
.477
180
.475
181
.475
182
.475
183
.475
184
.473
185
.471
186
.471
187
.469
188
.469
189
.469
190
.469
191
.469
192
.469
193
.469
194
.467
195
.467
196
.463
197
.463
198
.463
199
.463
200
.463
201
.460
202
.460
203
.458
204
.458
205
.456
206
.456
207
.452
208
.452
209
.450
210
.448
211
.446
212
.444
213
.442
214
.438
215
.438
216
.438
217
.438
218
.438
219
.438
220
.438
221
.438
222
.438
223
.438
224
.435
225
.435
226
.435
227
.433
228
.425
229
.423
230
.423
231
.421
232
.417
233
.417
234
.412
235
.410
236
.408
237
.406
238
.406
239
.404
240
.404
241
.400
242
.396
243
.396
244
.392
245
.390
246
.373
247
.358
248
.327
249
.219
250
.117
251
.106
252
.094
253
.087
254
.081
255
.069
256
.067
257
.067
258
.062
259
.062
260
.062
261
.062
262
.062
263
.062
264
.062
265
.062
266
.062
267
.062
268
.062
269
.062
270
.060
271
.060
272
.060
273
.054
274
.052
275
.048
276
.046
277
.029
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonIII

Metric: top1