Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021lowpass-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.787
2
.666
3
.657
4
.645
5
.642
6
.641
7
.640
8
.639
9
.629
10
.627
11
.626
12
.619
13
.619
14
.616
15
.616
16
.615
17
.615
18
.615
19
.613
20
.611
21
.609
22
.605
23
.580
24
.570
25
.568
26
.568
27
.561
28
.557
29
.556
30
.555
31
.547
32
.544
33
.544
34
.541
35
.541
36
.540
37
.540
38
.539
39
.537
40
.536
41
.530
42
.527
43
.526
44
.526
45
.526
46
.522
47
.519
48
.516
49
.505
50
.505
51
.505
52
.497
53
.495
54
.494
55
.494
56
.494
57
.489
58
.487
59
.487
60
.486
61
.485
62
.485
63
.484
64
.484
65
.484
66
.484
67
.484
68
.484
69
.482
70
.481
71
.481
72
.481
73
.479
74
.477
75
.477
76
.477
77
.477
78
.477
79
.476
80
.476
81
.476
82
.474
83
.474
84
.474
85
.474
86
.472
87
.471
88
.469
89
.469
90
.469
91
.468
92
.466
93
.466
94
.464
95
.463
96
.463
97
.461
98
.460
99
.460
100
.460
101
.460
102
.459
103
.459
104
.458
105
.456
106
.456
107
.454
108
.454
109
.454
110
.453
111
.453
112
.453
113
.453
114
.453
115
.453
116
.451
117
.451
118
.450
119
.449
120
.449
121
.449
122
.448
123
.446
124
.446
125
.446
126
.446
127
.445
128
.444
129
.444
130
.443
131
.441
132
.440
133
.440
134
.439
135
.439
136
.439
137
.439
138
.438
139
.436
140
.434
141
.434
142
.432
143
.432
144
.431
145
.431
146
.431
147
.431
148
.427
149
.425
150
.425
151
.425
152
.424
153
.422
154
.422
155
.421
156
.420
157
.420
158
.419
159
.417
160
.415
161
.414
162
.414
163
.412
164
.411
165
.410
166
.410
167
.410
168
.407
169
.404
170
.404
171
.404
172
.399
173
.398
174
.398
175
.396
176
.395
177
.395
178
.395
179
.393
180
.391
181
.390
182
.389
183
.389
184
.388
185
.388
186
.388
187
.385
188
.380
189
.379
190
.379
191
.379
192
.378
193
.376
194
.376
195
.374
196
.374
197
.372
198
.372
199
.369
200
.369
201
.366
202
.365
203
.364
204
.364
205
.361
206
.361
207
.361
208
.360
209
.360
210
.357
211
.357
212
.356
213
.356
214
.355
215
.354
216
.351
217
.349
218
.349
219
.349
220
.349
221
.346
222
.345
223
.345
224
.345
225
.345
226
.345
227
.344
228
.344
229
.343
230
.340
231
.339
232
.338
233
.338
234
.338
235
.335
236
.335
237
.328
238
.328
239
.326
240
.326
241
.326
242
.326
243
.326
244
.321
245
.320
246
.314
247
.312
248
.312
249
.311
250
.309
251
.307
252
.304
253
.302
254
.300
255
.299
256
.297
257
.296
258
.295
259
.294
260
.294
261
.294
262
.292
263
.291
264
.291
265
.291
266
.290
267
.286
268
.286
269
.282
270
.279
271
.259
272
.250
273
.101
274
.101
275
.099
276
.071
277
.070
278
.068
279
.065
280
.064
281
.064
282
.064
283
.062
284
.062
285
.062
286
.062
287
.062
288
.062
289
.062
290
.062
291
.062
292
.062
293
.062
294
.062
295
.059
296
.058
297
.058
298
.056
299
.056
300
.056
301
.055
302
.050
303
.049
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021lowpass

Metric: top1