Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonI-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.654
2
.637
3
.630
4
.627
5
.625
6
.625
7
.625
8
.625
9
.625
10
.618
11
.606
12
.606
13
.603
14
.603
15
.603
16
.603
17
.601
18
.595
19
.590
20
.588
21
.585
22
.584
23
.583
24
.583
25
.581
26
.579
27
.578
28
.576
29
.575
30
.571
31
.566
32
.565
33
.562
34
.560
35
.559
36
.559
37
.557
38
.557
39
.556
40
.556
41
.555
42
.551
43
.550
44
.550
45
.547
46
.547
47
.546
48
.546
49
.546
50
.545
51
.544
52
.542
53
.542
54
.541
55
.541
56
.539
57
.537
58
.537
59
.537
60
.536
61
.536
62
.535
63
.535
64
.535
65
.535
66
.534
67
.534
68
.534
69
.534
70
.534
71
.532
72
.532
73
.530
74
.529
75
.529
76
.529
77
.527
78
.527
79
.527
80
.527
81
.526
82
.526
83
.526
84
.524
85
.522
86
.522
87
.522
88
.521
89
.521
90
.520
91
.520
92
.520
93
.519
94
.519
95
.519
96
.519
97
.519
98
.517
99
.517
100
.516
101
.516
102
.516
103
.516
104
.516
105
.515
106
.515
107
.515
108
.515
109
.515
110
.515
111
.515
112
.515
113
.514
114
.514
115
.514
116
.512
117
.512
118
.511
119
.510
120
.510
121
.510
122
.510
123
.509
124
.507
125
.507
126
.506
127
.505
128
.505
129
.505
130
.504
131
.502
132
.502
133
.501
134
.501
135
.500
136
.500
137
.499
138
.499
139
.499
140
.497
141
.497
142
.497
143
.497
144
.496
145
.496
146
.495
147
.495
148
.494
149
.494
150
.494
151
.492
152
.491
153
.490
154
.490
155
.490
156
.489
157
.489
158
.487
159
.486
160
.486
161
.485
162
.485
163
.484
164
.482
165
.482
166
.481
167
.481
168
.481
169
.479
170
.477
171
.477
172
.477
173
.476
174
.476
175
.476
176
.475
177
.475
178
.474
179
.474
180
.474
181
.474
182
.474
183
.474
184
.474
185
.474
186
.474
187
.474
188
.474
189
.472
190
.471
191
.471
192
.471
193
.471
194
.470
195
.470
196
.469
197
.469
198
.469
199
.468
200
.468
201
.466
202
.464
203
.464
204
.464
205
.464
206
.463
207
.463
208
.461
209
.461
210
.460
211
.460
212
.459
213
.458
214
.455
215
.454
216
.454
217
.453
218
.453
219
.451
220
.450
221
.449
222
.449
223
.448
224
.448
225
.446
226
.445
227
.444
228
.444
229
.443
230
.439
231
.438
232
.436
233
.434
234
.431
235
.430
236
.430
237
.426
238
.425
239
.425
240
.424
241
.422
242
.419
243
.412
244
.409
245
.404
246
.393
247
.376
248
.359
249
.357
250
.280
251
.133
252
.106
253
.101
254
.085
255
.076
256
.075
257
.066
258
.062
259
.062
260
.062
261
.062
262
.062
263
.062
264
.062
265
.062
266
.062
267
.059
268
.059
269
.056
270
.054
271
.052
272
.051
273
.051
274
.051
275
.050
276
.050
277
.048
278
.044
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonI

Metric: top1