Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonII-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.683
2
.675
3
.667
4
.656
5
.648
6
.647
7
.647
8
.644
9
.637
10
.636
11
.634
12
.634
13
.631
14
.622
15
.620
16
.620
17
.617
18
.616
19
.616
20
.613
21
.608
22
.605
23
.602
24
.602
25
.600
26
.600
27
.600
28
.600
29
.597
30
.595
31
.594
32
.594
33
.592
34
.592
35
.589
36
.581
37
.581
38
.580
39
.580
40
.578
41
.578
42
.578
43
.577
44
.577
45
.577
46
.577
47
.573
48
.573
49
.572
50
.570
51
.570
52
.570
53
.569
54
.569
55
.567
56
.567
57
.567
58
.567
59
.566
60
.566
61
.564
62
.562
63
.562
64
.561
65
.559
66
.559
67
.559
68
.559
69
.558
70
.558
71
.558
72
.558
73
.558
74
.556
75
.556
76
.555
77
.555
78
.555
79
.553
80
.552
81
.552
82
.552
83
.552
84
.552
85
.550
86
.550
87
.548
88
.548
89
.547
90
.547
91
.545
92
.545
93
.545
94
.544
95
.542
96
.542
97
.541
98
.541
99
.539
100
.539
101
.539
102
.539
103
.539
104
.539
105
.537
106
.537
107
.537
108
.537
109
.536
110
.536
111
.534
112
.534
113
.534
114
.534
115
.533
116
.533
117
.531
118
.531
119
.531
120
.530
121
.530
122
.528
123
.528
124
.528
125
.528
126
.527
127
.523
128
.522
129
.520
130
.520
131
.519
132
.517
133
.517
134
.517
135
.516
136
.516
137
.514
138
.514
139
.514
140
.512
141
.512
142
.511
143
.511
144
.511
145
.509
146
.508
147
.506
148
.506
149
.506
150
.505
151
.505
152
.503
153
.502
154
.502
155
.500
156
.498
157
.498
158
.497
159
.497
160
.495
161
.495
162
.494
163
.492
164
.492
165
.489
166
.489
167
.487
168
.487
169
.486
170
.486
171
.486
172
.486
173
.483
174
.483
175
.481
176
.481
177
.481
178
.480
179
.480
180
.478
181
.477
182
.475
183
.475
184
.475
185
.475
186
.473
187
.473
188
.473
189
.473
190
.470
191
.469
192
.467
193
.467
194
.467
195
.464
196
.464
197
.464
198
.463
199
.463
200
.461
201
.459
202
.459
203
.458
204
.456
205
.456
206
.455
207
.455
208
.455
209
.453
210
.453
211
.452
212
.450
213
.448
214
.448
215
.448
216
.448
217
.448
218
.448
219
.448
220
.448
221
.448
222
.448
223
.447
224
.447
225
.441
226
.441
227
.434
228
.434
229
.433
230
.431
231
.430
232
.430
233
.428
234
.425
235
.423
236
.420
237
.420
238
.419
239
.416
240
.411
241
.408
242
.405
243
.405
244
.405
245
.395
246
.381
247
.353
248
.336
249
.280
250
.128
251
.117
252
.116
253
.084
254
.080
255
.077
256
.077
257
.073
258
.073
259
.067
260
.064
261
.064
262
.062
263
.062
264
.062
265
.062
266
.062
267
.062
268
.062
269
.062
270
.062
271
.062
272
.062
273
.061
274
.059
275
.059
276
.052
277
.045
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonII

Metric: top1