Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021lowpass-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.818
2
.801
3
.787
4
.779
5
.771
6
.736
7
.708
8
.679
9
.666
10
.657
11
.645
12
.642
13
.641
14
.640
15
.639
16
.632
17
.629
18
.627
19
.626
20
.619
21
.619
22
.616
23
.616
24
.615
25
.615
26
.615
27
.613
28
.611
29
.609
30
.605
31
.603
32
.580
33
.579
34
.570
35
.568
36
.568
37
.561
38
.557
39
.556
40
.555
41
.551
42
.547
43
.544
44
.544
45
.541
46
.541
47
.540
48
.540
49
.539
50
.537
51
.536
52
.536
53
.530
54
.527
55
.526
56
.526
57
.526
58
.522
59
.519
60
.516
61
.515
62
.506
63
.505
64
.505
65
.505
66
.505
67
.497
68
.496
69
.495
70
.494
71
.494
72
.492
73
.489
74
.487
75
.487
76
.486
77
.485
78
.485
79
.484
80
.484
81
.484
82
.484
83
.484
84
.481
85
.481
86
.481
87
.479
88
.477
89
.477
90
.477
91
.476
92
.476
93
.476
94
.476
95
.474
96
.474
97
.474
98
.472
99
.471
100
.469
101
.469
102
.469
103
.468
104
.466
105
.466
106
.464
107
.463
108
.463
109
.461
110
.460
111
.460
112
.460
113
.459
114
.458
115
.456
116
.456
117
.454
118
.454
119
.454
120
.453
121
.453
122
.453
123
.453
124
.453
125
.453
126
.451
127
.450
128
.449
129
.449
130
.449
131
.448
132
.446
133
.446
134
.446
135
.446
136
.445
137
.444
138
.444
139
.444
140
.443
141
.441
142
.440
143
.440
144
.439
145
.439
146
.439
147
.439
148
.438
149
.436
150
.434
151
.434
152
.432
153
.432
154
.431
155
.431
156
.431
157
.431
158
.427
159
.425
160
.425
161
.425
162
.424
163
.422
164
.422
165
.421
166
.420
167
.420
168
.419
169
.417
170
.415
171
.415
172
.414
173
.414
174
.412
175
.411
176
.410
177
.410
178
.410
179
.407
180
.404
181
.404
182
.404
183
.399
184
.398
185
.398
186
.396
187
.395
188
.395
189
.395
190
.393
191
.391
192
.390
193
.389
194
.389
195
.388
196
.388
197
.388
198
.385
199
.385
200
.380
201
.379
202
.379
203
.379
204
.378
205
.376
206
.376
207
.374
208
.374
209
.372
210
.372
211
.369
212
.369
213
.366
214
.365
215
.364
216
.364
217
.361
218
.361
219
.361
220
.360
221
.360
222
.357
223
.357
224
.356
225
.356
226
.355
227
.354
228
.351
229
.349
230
.349
231
.349
232
.349
233
.346
234
.345
235
.345
236
.345
237
.345
238
.345
239
.344
240
.344
241
.343
242
.340
243
.339
244
.338
245
.338
246
.338
247
.335
248
.335
249
.328
250
.328
251
.326
252
.326
253
.326
254
.326
255
.326
256
.321
257
.320
258
.319
259
.319
260
.314
261
.312
262
.312
263
.312
264
.311
265
.309
266
.307
267
.305
268
.304
269
.302
270
.300
271
.299
272
.297
273
.296
274
.295
275
.295
276
.295
277
.295
278
.295
279
.294
280
.294
281
.294
282
.292
283
.291
284
.291
285
.291
286
.290
287
.286
288
.286
289
.282
290
.279
291
.259
292
.250
293
.101
294
.101
295
.099
296
.071
297
.070
298
.068
299
.065
300
.064
301
.064
302
.064
303
.062
304
.062
305
.062
306
.062
307
.062
308
.062
309
.062
310
.062
311
.062
312
.062
313
.062
314
.059
315
.058
316
.058
317
.056
318
.056
319
.055
320
.050
321
.049
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021lowpass

Metric: top1