Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021eidolonI-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.654
2
.637
3
.630
4
.627
5
.625
6
.625
7
.625
8
.625
9
.625
10
.618
11
.606
12
.606
13
.603
14
.603
15
.603
16
.603
17
.601
18
.595
19
.590
20
.588
21
.585
22
.584
23
.583
24
.583
25
.581
26
.579
27
.578
28
.576
29
.575
30
.575
31
.575
32
.575
33
.571
34
.566
35
.565
36
.562
37
.560
38
.559
39
.559
40
.557
41
.557
42
.556
43
.556
44
.555
45
.551
46
.550
47
.550
48
.547
49
.547
50
.546
51
.546
52
.546
53
.545
54
.544
55
.542
56
.542
57
.541
58
.541
59
.539
60
.537
61
.537
62
.537
63
.536
64
.536
65
.535
66
.535
67
.535
68
.535
69
.534
70
.534
71
.534
72
.534
73
.534
74
.532
75
.532
76
.530
77
.529
78
.529
79
.529
80
.527
81
.527
82
.527
83
.527
84
.526
85
.526
86
.526
87
.524
88
.522
89
.522
90
.522
91
.521
92
.521
93
.520
94
.520
95
.520
96
.519
97
.519
98
.519
99
.519
100
.519
101
.517
102
.517
103
.516
104
.516
105
.516
106
.516
107
.516
108
.515
109
.515
110
.515
111
.515
112
.515
113
.515
114
.515
115
.515
116
.514
117
.514
118
.514
119
.512
120
.512
121
.511
122
.510
123
.510
124
.510
125
.510
126
.509
127
.507
128
.507
129
.506
130
.505
131
.505
132
.505
133
.504
134
.502
135
.502
136
.501
137
.501
138
.500
139
.500
140
.499
141
.499
142
.499
143
.497
144
.497
145
.497
146
.497
147
.496
148
.496
149
.495
150
.495
151
.494
152
.494
153
.494
154
.492
155
.491
156
.490
157
.490
158
.490
159
.489
160
.489
161
.487
162
.486
163
.486
164
.485
165
.485
166
.484
167
.482
168
.482
169
.481
170
.481
171
.481
172
.479
173
.477
174
.477
175
.477
176
.476
177
.476
178
.476
179
.475
180
.475
181
.474
182
.474
183
.474
184
.474
185
.474
186
.474
187
.474
188
.474
189
.474
190
.474
191
.474
192
.474
193
.474
194
.474
195
.474
196
.472
197
.471
198
.471
199
.471
200
.471
201
.470
202
.470
203
.469
204
.469
205
.469
206
.468
207
.468
208
.466
209
.464
210
.464
211
.464
212
.464
213
.463
214
.463
215
.461
216
.461
217
.460
218
.460
219
.459
220
.458
221
.455
222
.454
223
.454
224
.453
225
.453
226
.451
227
.450
228
.449
229
.449
230
.448
231
.448
232
.446
233
.445
234
.444
235
.444
236
.443
237
.439
238
.438
239
.436
240
.434
241
.431
242
.430
243
.430
244
.426
245
.425
246
.425
247
.424
248
.422
249
.419
250
.412
251
.409
252
.404
253
.393
254
.376
255
.359
256
.357
257
.280
258
.133
259
.106
260
.101
261
.085
262
.076
263
.075
264
.066
265
.062
266
.062
267
.062
268
.062
269
.062
270
.062
271
.062
272
.062
273
.062
274
.062
275
.062
276
.062
277
.059
278
.059
279
.056
280
.054
281
.052
282
.051
283
.051
284
.051
285
.050
286
.050
287
.048
288
.044
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021eidolonI

Metric: top1