Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021lowpass-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.787
2
.666
3
.657
4
.645
5
.642
6
.641
7
.640
8
.627
9
.626
10
.619
11
.619
12
.616
13
.615
14
.615
15
.615
16
.613
17
.611
18
.609
19
.605
20
.580
21
.570
22
.568
23
.568
24
.561
25
.557
26
.556
27
.555
28
.547
29
.544
30
.544
31
.541
32
.541
33
.540
34
.540
35
.537
36
.536
37
.530
38
.527
39
.526
40
.526
41
.526
42
.522
43
.519
44
.516
45
.505
46
.505
47
.505
48
.497
49
.495
50
.494
51
.494
52
.489
53
.487
54
.487
55
.486
56
.485
57
.485
58
.484
59
.484
60
.484
61
.484
62
.481
63
.481
64
.479
65
.477
66
.477
67
.476
68
.476
69
.476
70
.474
71
.474
72
.472
73
.471
74
.469
75
.469
76
.469
77
.468
78
.464
79
.463
80
.463
81
.460
82
.460
83
.460
84
.459
85
.454
86
.454
87
.454
88
.453
89
.453
90
.453
91
.453
92
.453
93
.451
94
.450
95
.449
96
.449
97
.449
98
.448
99
.446
100
.446
101
.446
102
.446
103
.445
104
.444
105
.444
106
.443
107
.441
108
.440
109
.440
110
.439
111
.439
112
.439
113
.439
114
.438
115
.436
116
.434
117
.434
118
.432
119
.432
120
.431
121
.431
122
.431
123
.431
124
.427
125
.425
126
.425
127
.425
128
.424
129
.422
130
.422
131
.421
132
.420
133
.419
134
.417
135
.415
136
.414
137
.414
138
.411
139
.410
140
.410
141
.410
142
.407
143
.404
144
.404
145
.404
146
.399
147
.398
148
.398
149
.396
150
.395
151
.395
152
.395
153
.393
154
.390
155
.389
156
.389
157
.388
158
.388
159
.388
160
.385
161
.380
162
.379
163
.379
164
.379
165
.378
166
.376
167
.376
168
.374
169
.374
170
.372
171
.372
172
.369
173
.369
174
.366
175
.365
176
.364
177
.364
178
.361
179
.361
180
.361
181
.360
182
.360
183
.357
184
.357
185
.356
186
.356
187
.355
188
.354
189
.351
190
.349
191
.349
192
.349
193
.349
194
.346
195
.345
196
.345
197
.345
198
.345
199
.345
200
.345
201
.345
202
.345
203
.345
204
.344
205
.344
206
.343
207
.340
208
.339
209
.338
210
.338
211
.338
212
.335
213
.335
214
.328
215
.328
216
.326
217
.326
218
.321
219
.320
220
.314
221
.312
222
.312
223
.312
224
.311
225
.309
226
.307
227
.304
228
.302
229
.300
230
.299
231
.297
232
.296
233
.295
234
.294
235
.294
236
.294
237
.292
238
.291
239
.291
240
.291
241
.290
242
.286
243
.286
244
.282
245
.279
246
.259
247
.250
248
.101
249
.101
250
.099
251
.071
252
.070
253
.068
254
.065
255
.064
256
.064
257
.064
258
.062
259
.062
260
.062
261
.062
262
.062
263
.062
264
.062
265
.062
266
.062
267
.059
268
.058
269
.058
270
.056
271
.056
272
.056
273
.055
274
.050
275
.049
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021lowpass

Metric: top1