Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonII-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.683
2
.675
3
.667
4
.656
5
.648
6
.647
7
.647
8
.644
9
.637
10
.636
11
.634
12
.634
13
.631
14
.622
15
.620
16
.620
17
.617
18
.616
19
.616
20
.613
21
.608
22
.605
23
.602
24
.602
25
.600
26
.600
27
.600
28
.600
29
.597
30
.595
31
.594
32
.594
33
.592
34
.592
35
.589
36
.584
37
.581
38
.581
39
.580
40
.580
41
.578
42
.578
43
.578
44
.577
45
.577
46
.577
47
.577
48
.573
49
.573
50
.572
51
.570
52
.570
53
.570
54
.569
55
.569
56
.567
57
.567
58
.567
59
.567
60
.566
61
.566
62
.564
63
.562
64
.562
65
.561
66
.559
67
.559
68
.559
69
.559
70
.558
71
.558
72
.558
73
.558
74
.558
75
.556
76
.556
77
.555
78
.555
79
.555
80
.553
81
.552
82
.552
83
.552
84
.552
85
.552
86
.550
87
.550
88
.548
89
.548
90
.547
91
.547
92
.545
93
.545
94
.545
95
.544
96
.542
97
.542
98
.541
99
.541
100
.539
101
.539
102
.539
103
.539
104
.539
105
.539
106
.537
107
.537
108
.537
109
.537
110
.536
111
.536
112
.534
113
.534
114
.534
115
.534
116
.533
117
.533
118
.531
119
.531
120
.531
121
.530
122
.530
123
.528
124
.528
125
.528
126
.528
127
.527
128
.523
129
.522
130
.520
131
.520
132
.519
133
.517
134
.517
135
.517
136
.516
137
.516
138
.514
139
.514
140
.514
141
.512
142
.512
143
.511
144
.511
145
.511
146
.509
147
.508
148
.506
149
.506
150
.506
151
.505
152
.505
153
.503
154
.502
155
.502
156
.500
157
.498
158
.498
159
.497
160
.497
161
.495
162
.495
163
.494
164
.492
165
.492
166
.489
167
.489
168
.487
169
.487
170
.486
171
.486
172
.486
173
.486
174
.483
175
.483
176
.481
177
.481
178
.481
179
.480
180
.480
181
.478
182
.477
183
.475
184
.475
185
.475
186
.475
187
.473
188
.473
189
.473
190
.473
191
.470
192
.469
193
.467
194
.467
195
.467
196
.464
197
.464
198
.464
199
.463
200
.463
201
.461
202
.459
203
.459
204
.458
205
.456
206
.456
207
.455
208
.455
209
.455
210
.453
211
.453
212
.452
213
.450
214
.448
215
.448
216
.448
217
.448
218
.448
219
.448
220
.448
221
.448
222
.448
223
.448
224
.447
225
.447
226
.441
227
.441
228
.434
229
.434
230
.433
231
.431
232
.430
233
.430
234
.428
235
.425
236
.423
237
.420
238
.420
239
.419
240
.416
241
.411
242
.408
243
.405
244
.405
245
.405
246
.395
247
.381
248
.353
249
.336
250
.280
251
.128
252
.117
253
.116
254
.084
255
.080
256
.077
257
.077
258
.073
259
.073
260
.067
261
.064
262
.064
263
.062
264
.062
265
.062
266
.062
267
.062
268
.062
269
.062
270
.062
271
.062
272
.062
273
.062
274
.061
275
.059
276
.059
277
.052
278
.045
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonII

Metric: top1