Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonIII-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.800
2
.794
3
.777
4
.767
5
.758
6
.754
7
.752
8
.750
9
.733
10
.731
11
.717
12
.715
13
.715
14
.715
15
.715
16
.710
17
.708
18
.708
19
.700
20
.696
21
.692
22
.692
23
.688
24
.688
25
.683
26
.683
27
.683
28
.679
29
.677
30
.665
31
.665
32
.662
33
.662
34
.660
35
.658
36
.658
37
.654
38
.654
39
.654
40
.652
41
.646
42
.646
43
.637
44
.635
45
.635
46
.633
47
.633
48
.631
49
.627
50
.627
51
.627
52
.627
53
.625
54
.625
55
.625
56
.625
57
.623
58
.623
59
.619
60
.619
61
.619
62
.613
63
.613
64
.610
65
.608
66
.608
67
.608
68
.606
69
.604
70
.602
71
.602
72
.602
73
.602
74
.602
75
.596
76
.596
77
.596
78
.596
79
.596
80
.596
81
.594
82
.594
83
.590
84
.590
85
.590
86
.588
87
.585
88
.585
89
.585
90
.585
91
.585
92
.585
93
.583
94
.581
95
.581
96
.579
97
.577
98
.575
99
.575
100
.573
101
.573
102
.573
103
.571
104
.571
105
.569
106
.569
107
.567
108
.567
109
.565
110
.565
111
.562
112
.560
113
.558
114
.558
115
.558
116
.558
117
.558
118
.556
119
.556
120
.556
121
.556
122
.554
123
.554
124
.552
125
.552
126
.552
127
.550
128
.550
129
.550
130
.550
131
.550
132
.550
133
.550
134
.550
135
.550
136
.550
137
.548
138
.548
139
.546
140
.546
141
.546
142
.542
143
.542
144
.540
145
.540
146
.540
147
.540
148
.540
149
.537
150
.537
151
.537
152
.535
153
.535
154
.533
155
.533
156
.531
157
.531
158
.529
159
.529
160
.529
161
.527
162
.527
163
.527
164
.527
165
.525
166
.525
167
.523
168
.523
169
.521
170
.521
171
.521
172
.519
173
.519
174
.519
175
.517
176
.517
177
.515
178
.515
179
.515
180
.515
181
.512
182
.512
183
.510
184
.510
185
.508
186
.506
187
.506
188
.504
189
.504
190
.502
191
.502
192
.502
193
.502
194
.500
195
.500
196
.500
197
.498
198
.498
199
.498
200
.498
201
.498
202
.496
203
.496
204
.494
205
.494
206
.492
207
.492
208
.490
209
.490
210
.490
211
.487
212
.485
213
.485
214
.483
215
.483
216
.483
217
.483
218
.481
219
.477
220
.475
221
.475
222
.475
223
.475
224
.473
225
.473
226
.471
227
.471
228
.469
229
.469
230
.469
231
.469
232
.469
233
.469
234
.469
235
.467
236
.467
237
.465
238
.465
239
.465
240
.465
241
.463
242
.463
243
.463
244
.463
245
.463
246
.460
247
.460
248
.458
249
.458
250
.456
251
.456
252
.452
253
.452
254
.450
255
.448
256
.446
257
.446
258
.444
259
.444
260
.444
261
.442
262
.438
263
.438
264
.438
265
.438
266
.438
267
.438
268
.435
269
.435
270
.435
271
.433
272
.425
273
.423
274
.423
275
.421
276
.417
277
.417
278
.412
279
.408
280
.406
281
.406
282
.404
283
.404
284
.400
285
.396
286
.396
287
.392
288
.390
289
.373
290
.358
291
.327
292
.219
293
.117
294
.106
295
.094
296
.087
297
.081
298
.069
299
.067
300
.067
301
.062
302
.062
303
.062
304
.062
305
.062
306
.062
307
.062
308
.062
309
.062
310
.062
311
.062
312
.062
313
.062
314
.062
315
.060
316
.060
317
.054
318
.052
319
.048
320
.046
321
.029
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonIII

Metric: top1