Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonII-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.722
2
.719
3
.708
4
.695
5
.683
6
.683
7
.675
8
.672
9
.667
10
.664
11
.656
12
.655
13
.650
14
.648
15
.647
16
.647
17
.647
18
.644
19
.637
20
.636
21
.634
22
.634
23
.634
24
.633
25
.633
26
.631
27
.622
28
.620
29
.620
30
.617
31
.616
32
.616
33
.616
34
.613
35
.608
36
.605
37
.602
38
.602
39
.600
40
.600
41
.600
42
.600
43
.598
44
.597
45
.597
46
.597
47
.597
48
.595
49
.594
50
.594
51
.592
52
.592
53
.589
54
.588
55
.584
56
.581
57
.581
58
.580
59
.580
60
.578
61
.578
62
.578
63
.577
64
.577
65
.577
66
.577
67
.573
68
.573
69
.572
70
.570
71
.570
72
.570
73
.569
74
.569
75
.567
76
.567
77
.567
78
.567
79
.566
80
.566
81
.564
82
.564
83
.562
84
.562
85
.562
86
.561
87
.559
88
.559
89
.559
90
.559
91
.558
92
.558
93
.558
94
.558
95
.558
96
.556
97
.556
98
.555
99
.555
100
.555
101
.553
102
.552
103
.552
104
.552
105
.552
106
.552
107
.550
108
.550
109
.548
110
.548
111
.547
112
.547
113
.545
114
.545
115
.545
116
.544
117
.542
118
.542
119
.542
120
.541
121
.541
122
.539
123
.539
124
.539
125
.539
126
.539
127
.539
128
.537
129
.537
130
.537
131
.537
132
.536
133
.536
134
.536
135
.534
136
.534
137
.534
138
.534
139
.533
140
.533
141
.531
142
.531
143
.531
144
.531
145
.530
146
.530
147
.530
148
.528
149
.528
150
.528
151
.528
152
.527
153
.523
154
.523
155
.522
156
.520
157
.520
158
.519
159
.517
160
.517
161
.517
162
.516
163
.516
164
.516
165
.514
166
.514
167
.514
168
.512
169
.512
170
.511
171
.511
172
.511
173
.509
174
.508
175
.506
176
.506
177
.506
178
.505
179
.505
180
.505
181
.503
182
.502
183
.502
184
.500
185
.498
186
.498
187
.498
188
.497
189
.497
190
.495
191
.495
192
.494
193
.492
194
.492
195
.489
196
.489
197
.487
198
.487
199
.486
200
.486
201
.486
202
.486
203
.486
204
.483
205
.483
206
.481
207
.481
208
.481
209
.480
210
.480
211
.478
212
.477
213
.475
214
.475
215
.475
216
.475
217
.473
218
.473
219
.473
220
.473
221
.473
222
.470
223
.469
224
.467
225
.467
226
.467
227
.464
228
.464
229
.464
230
.463
231
.463
232
.461
233
.459
234
.459
235
.458
236
.456
237
.456
238
.455
239
.455
240
.455
241
.453
242
.453
243
.452
244
.450
245
.448
246
.448
247
.448
248
.448
249
.448
250
.448
251
.447
252
.447
253
.441
254
.441
255
.434
256
.434
257
.433
258
.431
259
.430
260
.430
261
.428
262
.425
263
.423
264
.420
265
.420
266
.419
267
.416
268
.409
269
.408
270
.405
271
.405
272
.405
273
.395
274
.381
275
.353
276
.336
277
.280
278
.128
279
.117
280
.116
281
.084
282
.080
283
.077
284
.077
285
.073
286
.073
287
.067
288
.064
289
.064
290
.062
291
.062
292
.062
293
.062
294
.062
295
.062
296
.062
297
.062
298
.062
299
.062
300
.062
301
.062
302
.062
303
.059
304
.059
305
.052
306
.045
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonII

Metric: top1