Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021lowpass-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.787
2
.666
3
.657
4
.645
5
.642
6
.641
7
.640
8
.627
9
.626
10
.619
11
.619
12
.616
13
.615
14
.615
15
.615
16
.613
17
.611
18
.609
19
.605
20
.580
21
.570
22
.568
23
.568
24
.561
25
.557
26
.556
27
.555
28
.547
29
.544
30
.544
31
.541
32
.541
33
.540
34
.540
35
.537
36
.536
37
.530
38
.527
39
.526
40
.526
41
.526
42
.522
43
.519
44
.516
45
.505
46
.505
47
.505
48
.497
49
.495
50
.494
51
.494
52
.489
53
.487
54
.487
55
.486
56
.485
57
.485
58
.484
59
.484
60
.484
61
.484
62
.481
63
.481
64
.479
65
.477
66
.477
67
.476
68
.476
69
.476
70
.474
71
.474
72
.472
73
.471
74
.469
75
.469
76
.469
77
.468
78
.466
79
.464
80
.463
81
.463
82
.460
83
.460
84
.460
85
.459
86
.454
87
.454
88
.454
89
.453
90
.453
91
.453
92
.453
93
.453
94
.451
95
.450
96
.449
97
.449
98
.449
99
.448
100
.446
101
.446
102
.446
103
.446
104
.445
105
.444
106
.444
107
.443
108
.441
109
.440
110
.440
111
.439
112
.439
113
.439
114
.439
115
.438
116
.436
117
.434
118
.434
119
.432
120
.432
121
.431
122
.431
123
.431
124
.431
125
.427
126
.425
127
.425
128
.425
129
.424
130
.422
131
.422
132
.421
133
.420
134
.419
135
.417
136
.415
137
.414
138
.414
139
.411
140
.410
141
.410
142
.410
143
.407
144
.404
145
.404
146
.404
147
.399
148
.398
149
.398
150
.396
151
.395
152
.395
153
.395
154
.393
155
.390
156
.389
157
.389
158
.388
159
.388
160
.388
161
.385
162
.380
163
.379
164
.379
165
.379
166
.378
167
.376
168
.376
169
.374
170
.374
171
.372
172
.372
173
.369
174
.369
175
.366
176
.365
177
.364
178
.364
179
.361
180
.361
181
.361
182
.360
183
.360
184
.357
185
.357
186
.356
187
.356
188
.355
189
.354
190
.351
191
.349
192
.349
193
.349
194
.349
195
.346
196
.345
197
.345
198
.345
199
.345
200
.345
201
.345
202
.345
203
.345
204
.345
205
.345
206
.345
207
.345
208
.345
209
.345
210
.344
211
.344
212
.343
213
.340
214
.339
215
.338
216
.338
217
.338
218
.335
219
.335
220
.328
221
.328
222
.326
223
.326
224
.326
225
.326
226
.326
227
.321
228
.320
229
.314
230
.312
231
.312
232
.312
233
.311
234
.309
235
.307
236
.304
237
.302
238
.300
239
.299
240
.297
241
.296
242
.295
243
.294
244
.294
245
.294
246
.292
247
.291
248
.291
249
.291
250
.290
251
.286
252
.286
253
.282
254
.279
255
.259
256
.250
257
.101
258
.101
259
.099
260
.071
261
.070
262
.068
263
.065
264
.064
265
.064
266
.064
267
.062
268
.062
269
.062
270
.062
271
.062
272
.062
273
.062
274
.062
275
.062
276
.062
277
.062
278
.062
279
.059
280
.058
281
.058
282
.056
283
.056
284
.056
285
.055
286
.050
287
.049
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021lowpass

Metric: top1