Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonI-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.654
2
.637
3
.630
4
.627
5
.625
6
.625
7
.625
8
.625
9
.625
10
.618
11
.606
12
.606
13
.603
14
.603
15
.603
16
.603
17
.601
18
.595
19
.590
20
.588
21
.585
22
.584
23
.583
24
.583
25
.581
26
.579
27
.578
28
.576
29
.575
30
.571
31
.566
32
.565
33
.562
34
.560
35
.559
36
.559
37
.557
38
.557
39
.556
40
.555
41
.551
42
.550
43
.550
44
.547
45
.547
46
.546
47
.546
48
.546
49
.545
50
.544
51
.542
52
.542
53
.541
54
.541
55
.539
56
.537
57
.537
58
.537
59
.536
60
.536
61
.535
62
.535
63
.535
64
.535
65
.534
66
.534
67
.534
68
.534
69
.534
70
.532
71
.532
72
.530
73
.529
74
.529
75
.529
76
.527
77
.527
78
.527
79
.527
80
.526
81
.526
82
.526
83
.524
84
.522
85
.522
86
.522
87
.521
88
.521
89
.520
90
.520
91
.520
92
.519
93
.519
94
.519
95
.519
96
.519
97
.517
98
.517
99
.516
100
.516
101
.516
102
.516
103
.516
104
.515
105
.515
106
.515
107
.515
108
.515
109
.515
110
.515
111
.515
112
.514
113
.514
114
.514
115
.512
116
.512
117
.511
118
.510
119
.510
120
.510
121
.510
122
.509
123
.507
124
.507
125
.506
126
.505
127
.505
128
.505
129
.504
130
.502
131
.502
132
.501
133
.501
134
.500
135
.500
136
.499
137
.499
138
.499
139
.497
140
.497
141
.497
142
.497
143
.496
144
.496
145
.495
146
.495
147
.494
148
.494
149
.494
150
.492
151
.491
152
.490
153
.490
154
.490
155
.489
156
.489
157
.487
158
.486
159
.486
160
.485
161
.485
162
.484
163
.482
164
.482
165
.481
166
.481
167
.481
168
.479
169
.477
170
.477
171
.477
172
.476
173
.476
174
.476
175
.475
176
.475
177
.474
178
.474
179
.474
180
.474
181
.474
182
.474
183
.474
184
.474
185
.474
186
.474
187
.474
188
.472
189
.471
190
.471
191
.471
192
.471
193
.470
194
.470
195
.469
196
.469
197
.469
198
.468
199
.468
200
.466
201
.464
202
.464
203
.464
204
.464
205
.463
206
.463
207
.461
208
.461
209
.460
210
.460
211
.459
212
.458
213
.455
214
.454
215
.454
216
.453
217
.453
218
.451
219
.450
220
.449
221
.449
222
.448
223
.448
224
.446
225
.445
226
.444
227
.444
228
.443
229
.439
230
.438
231
.436
232
.434
233
.431
234
.430
235
.430
236
.426
237
.425
238
.425
239
.424
240
.422
241
.419
242
.412
243
.409
244
.404
245
.393
246
.376
247
.359
248
.357
249
.280
250
.133
251
.106
252
.101
253
.085
254
.076
255
.075
256
.066
257
.062
258
.062
259
.062
260
.062
261
.062
262
.062
263
.062
264
.062
265
.062
266
.059
267
.059
268
.056
269
.054
270
.052
271
.051
272
.051
273
.051
274
.050
275
.050
276
.048
277
.044
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonI

Metric: top1