Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021lowpass-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.787
2
.666
3
.657
4
.645
5
.642
6
.641
7
.640
8
.627
9
.626
10
.619
11
.619
12
.616
13
.615
14
.615
15
.615
16
.613
17
.611
18
.609
19
.605
20
.580
21
.570
22
.568
23
.568
24
.561
25
.557
26
.556
27
.555
28
.547
29
.544
30
.544
31
.541
32
.541
33
.540
34
.540
35
.537
36
.536
37
.530
38
.527
39
.526
40
.526
41
.526
42
.522
43
.519
44
.516
45
.505
46
.505
47
.505
48
.497
49
.495
50
.494
51
.494
52
.489
53
.487
54
.487
55
.486
56
.485
57
.485
58
.484
59
.484
60
.484
61
.484
62
.481
63
.481
64
.479
65
.477
66
.477
67
.476
68
.476
69
.476
70
.474
71
.474
72
.472
73
.471
74
.469
75
.469
76
.469
77
.468
78
.466
79
.464
80
.463
81
.463
82
.460
83
.460
84
.460
85
.459
86
.454
87
.454
88
.454
89
.453
90
.453
91
.453
92
.453
93
.453
94
.451
95
.450
96
.449
97
.449
98
.449
99
.448
100
.446
101
.446
102
.446
103
.446
104
.445
105
.444
106
.444
107
.443
108
.441
109
.440
110
.440
111
.439
112
.439
113
.439
114
.439
115
.438
116
.436
117
.434
118
.434
119
.432
120
.432
121
.431
122
.431
123
.431
124
.431
125
.427
126
.425
127
.425
128
.425
129
.424
130
.422
131
.422
132
.421
133
.420
134
.419
135
.417
136
.415
137
.414
138
.414
139
.411
140
.410
141
.410
142
.410
143
.407
144
.404
145
.404
146
.404
147
.399
148
.398
149
.398
150
.396
151
.395
152
.395
153
.395
154
.393
155
.390
156
.389
157
.389
158
.388
159
.388
160
.388
161
.385
162
.380
163
.379
164
.379
165
.379
166
.378
167
.376
168
.376
169
.374
170
.374
171
.372
172
.372
173
.369
174
.369
175
.366
176
.365
177
.364
178
.364
179
.361
180
.361
181
.361
182
.360
183
.360
184
.357
185
.357
186
.356
187
.356
188
.355
189
.354
190
.351
191
.349
192
.349
193
.349
194
.349
195
.346
196
.345
197
.345
198
.345
199
.345
200
.345
201
.345
202
.345
203
.345
204
.345
205
.344
206
.344
207
.343
208
.340
209
.339
210
.338
211
.338
212
.338
213
.335
214
.335
215
.328
216
.328
217
.326
218
.326
219
.321
220
.320
221
.314
222
.312
223
.312
224
.312
225
.311
226
.309
227
.307
228
.304
229
.302
230
.300
231
.299
232
.297
233
.296
234
.295
235
.294
236
.294
237
.294
238
.292
239
.291
240
.291
241
.291
242
.290
243
.286
244
.286
245
.282
246
.279
247
.259
248
.250
249
.101
250
.101
251
.099
252
.071
253
.070
254
.068
255
.065
256
.064
257
.064
258
.064
259
.062
260
.062
261
.062
262
.062
263
.062
264
.062
265
.062
266
.062
267
.062
268
.059
269
.058
270
.058
271
.056
272
.056
273
.056
274
.055
275
.050
276
.049
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021lowpass

Metric: top1