Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonI-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.654
2
.637
3
.635
4
.630
5
.630
6
.627
7
.625
8
.625
9
.625
10
.625
11
.625
12
.618
13
.614
14
.613
15
.606
16
.606
17
.606
18
.604
19
.603
20
.603
21
.603
22
.603
23
.601
24
.596
25
.595
26
.591
27
.590
28
.588
29
.585
30
.584
31
.583
32
.583
33
.581
34
.579
35
.578
36
.578
37
.576
38
.575
39
.575
40
.575
41
.575
42
.575
43
.571
44
.570
45
.566
46
.565
47
.565
48
.564
49
.562
50
.560
51
.559
52
.559
53
.557
54
.557
55
.556
56
.556
57
.555
58
.552
59
.551
60
.550
61
.550
62
.549
63
.547
64
.547
65
.546
66
.546
67
.546
68
.545
69
.544
70
.542
71
.542
72
.541
73
.541
74
.539
75
.537
76
.537
77
.537
78
.536
79
.536
80
.536
81
.535
82
.535
83
.535
84
.535
85
.534
86
.534
87
.534
88
.534
89
.534
90
.532
91
.532
92
.530
93
.529
94
.529
95
.529
96
.527
97
.527
98
.527
99
.527
100
.526
101
.526
102
.526
103
.526
104
.524
105
.522
106
.522
107
.522
108
.521
109
.521
110
.520
111
.520
112
.520
113
.520
114
.519
115
.519
116
.519
117
.519
118
.519
119
.517
120
.517
121
.516
122
.516
123
.516
124
.516
125
.516
126
.515
127
.515
128
.515
129
.515
130
.515
131
.515
132
.515
133
.515
134
.514
135
.514
136
.514
137
.512
138
.512
139
.512
140
.511
141
.510
142
.510
143
.510
144
.510
145
.509
146
.507
147
.507
148
.506
149
.505
150
.505
151
.505
152
.504
153
.502
154
.502
155
.501
156
.501
157
.500
158
.500
159
.499
160
.499
161
.499
162
.497
163
.497
164
.497
165
.497
166
.496
167
.496
168
.495
169
.495
170
.495
171
.494
172
.494
173
.494
174
.492
175
.492
176
.491
177
.490
178
.490
179
.490
180
.489
181
.489
182
.487
183
.486
184
.486
185
.485
186
.485
187
.484
188
.482
189
.482
190
.481
191
.481
192
.481
193
.479
194
.477
195
.477
196
.477
197
.476
198
.476
199
.476
200
.475
201
.475
202
.474
203
.474
204
.474
205
.474
206
.474
207
.474
208
.474
209
.472
210
.471
211
.471
212
.471
213
.471
214
.470
215
.470
216
.469
217
.469
218
.469
219
.468
220
.468
221
.466
222
.465
223
.464
224
.464
225
.464
226
.464
227
.463
228
.463
229
.461
230
.461
231
.460
232
.460
233
.459
234
.458
235
.458
236
.455
237
.454
238
.454
239
.453
240
.453
241
.453
242
.451
243
.450
244
.449
245
.449
246
.448
247
.448
248
.446
249
.445
250
.444
251
.444
252
.443
253
.439
254
.438
255
.434
256
.431
257
.430
258
.430
259
.426
260
.425
261
.425
262
.424
263
.422
264
.419
265
.412
266
.409
267
.404
268
.395
269
.393
270
.376
271
.359
272
.357
273
.280
274
.133
275
.106
276
.101
277
.085
278
.076
279
.075
280
.066
281
.062
282
.062
283
.062
284
.062
285
.062
286
.062
287
.062
288
.062
289
.062
290
.062
291
.062
292
.059
293
.059
294
.056
295
.054
296
.052
297
.051
298
.051
299
.050
300
.050
301
.048
302
.044
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonI

Metric: top1