Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonI-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.654
2
.637
3
.630
4
.627
5
.625
6
.625
7
.625
8
.625
9
.625
10
.618
11
.606
12
.606
13
.603
14
.603
15
.603
16
.603
17
.601
18
.595
19
.590
20
.588
21
.585
22
.584
23
.583
24
.583
25
.581
26
.579
27
.578
28
.576
29
.575
30
.575
31
.575
32
.575
33
.571
34
.566
35
.565
36
.562
37
.560
38
.559
39
.559
40
.557
41
.557
42
.556
43
.556
44
.555
45
.551
46
.550
47
.550
48
.547
49
.547
50
.546
51
.546
52
.546
53
.545
54
.544
55
.542
56
.542
57
.541
58
.541
59
.539
60
.537
61
.537
62
.537
63
.536
64
.536
65
.535
66
.535
67
.535
68
.535
69
.534
70
.534
71
.534
72
.534
73
.534
74
.532
75
.532
76
.530
77
.529
78
.529
79
.529
80
.527
81
.527
82
.527
83
.527
84
.526
85
.526
86
.526
87
.524
88
.522
89
.522
90
.522
91
.521
92
.521
93
.520
94
.520
95
.520
96
.519
97
.519
98
.519
99
.519
100
.519
101
.517
102
.517
103
.516
104
.516
105
.516
106
.516
107
.516
108
.515
109
.515
110
.515
111
.515
112
.515
113
.515
114
.515
115
.515
116
.514
117
.514
118
.514
119
.512
120
.512
121
.511
122
.510
123
.510
124
.510
125
.510
126
.509
127
.507
128
.507
129
.506
130
.505
131
.505
132
.505
133
.504
134
.502
135
.502
136
.501
137
.501
138
.500
139
.500
140
.499
141
.499
142
.499
143
.497
144
.497
145
.497
146
.497
147
.496
148
.496
149
.495
150
.495
151
.494
152
.494
153
.494
154
.492
155
.491
156
.490
157
.490
158
.490
159
.489
160
.489
161
.487
162
.486
163
.486
164
.485
165
.485
166
.484
167
.482
168
.482
169
.481
170
.481
171
.481
172
.479
173
.477
174
.477
175
.477
176
.476
177
.476
178
.476
179
.475
180
.475
181
.474
182
.474
183
.474
184
.474
185
.474
186
.474
187
.474
188
.474
189
.474
190
.474
191
.474
192
.474
193
.474
194
.474
195
.474
196
.474
197
.472
198
.471
199
.471
200
.471
201
.471
202
.470
203
.470
204
.469
205
.469
206
.469
207
.468
208
.468
209
.466
210
.464
211
.464
212
.464
213
.464
214
.463
215
.463
216
.461
217
.461
218
.460
219
.460
220
.459
221
.458
222
.455
223
.454
224
.454
225
.453
226
.453
227
.451
228
.450
229
.449
230
.449
231
.448
232
.448
233
.446
234
.445
235
.444
236
.444
237
.443
238
.439
239
.438
240
.436
241
.434
242
.431
243
.430
244
.430
245
.426
246
.425
247
.425
248
.424
249
.422
250
.419
251
.412
252
.409
253
.404
254
.393
255
.376
256
.359
257
.357
258
.280
259
.133
260
.106
261
.101
262
.085
263
.076
264
.075
265
.066
266
.062
267
.062
268
.062
269
.062
270
.062
271
.062
272
.062
273
.062
274
.062
275
.062
276
.062
277
.062
278
.059
279
.059
280
.056
281
.054
282
.052
283
.051
284
.051
285
.051
286
.050
287
.050
288
.048
289
.044
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonI

Metric: top1