Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021lowpass-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.787
2
.666
3
.657
4
.645
5
.642
6
.641
7
.640
8
.627
9
.626
10
.619
11
.619
12
.616
13
.615
14
.615
15
.615
16
.613
17
.611
18
.609
19
.605
20
.580
21
.570
22
.568
23
.568
24
.561
25
.557
26
.556
27
.555
28
.547
29
.544
30
.544
31
.541
32
.541
33
.540
34
.540
35
.537
36
.536
37
.530
38
.527
39
.526
40
.526
41
.526
42
.522
43
.519
44
.516
45
.505
46
.505
47
.505
48
.497
49
.495
50
.494
51
.494
52
.489
53
.487
54
.487
55
.486
56
.485
57
.485
58
.484
59
.484
60
.484
61
.484
62
.481
63
.481
64
.481
65
.479
66
.477
67
.477
68
.476
69
.476
70
.476
71
.474
72
.474
73
.472
74
.471
75
.469
76
.469
77
.469
78
.468
79
.466
80
.464
81
.463
82
.463
83
.460
84
.460
85
.460
86
.459
87
.454
88
.454
89
.454
90
.453
91
.453
92
.453
93
.453
94
.453
95
.451
96
.450
97
.449
98
.449
99
.449
100
.448
101
.446
102
.446
103
.446
104
.446
105
.445
106
.444
107
.444
108
.443
109
.441
110
.440
111
.440
112
.439
113
.439
114
.439
115
.439
116
.438
117
.436
118
.434
119
.434
120
.432
121
.432
122
.431
123
.431
124
.431
125
.431
126
.427
127
.425
128
.425
129
.425
130
.424
131
.422
132
.422
133
.421
134
.420
135
.419
136
.417
137
.415
138
.414
139
.414
140
.412
141
.411
142
.410
143
.410
144
.410
145
.407
146
.404
147
.404
148
.404
149
.399
150
.398
151
.398
152
.396
153
.395
154
.395
155
.395
156
.393
157
.390
158
.389
159
.389
160
.388
161
.388
162
.388
163
.385
164
.380
165
.379
166
.379
167
.379
168
.378
169
.376
170
.376
171
.374
172
.374
173
.372
174
.372
175
.369
176
.369
177
.366
178
.365
179
.364
180
.364
181
.361
182
.361
183
.361
184
.360
185
.360
186
.357
187
.357
188
.356
189
.356
190
.355
191
.354
192
.351
193
.349
194
.349
195
.349
196
.349
197
.346
198
.345
199
.345
200
.345
201
.345
202
.345
203
.344
204
.344
205
.343
206
.340
207
.339
208
.338
209
.338
210
.338
211
.335
212
.335
213
.328
214
.328
215
.326
216
.326
217
.326
218
.326
219
.326
220
.321
221
.320
222
.314
223
.312
224
.312
225
.311
226
.309
227
.307
228
.304
229
.302
230
.300
231
.299
232
.297
233
.296
234
.295
235
.294
236
.294
237
.294
238
.292
239
.291
240
.291
241
.291
242
.290
243
.286
244
.286
245
.282
246
.279
247
.259
248
.250
249
.101
250
.101
251
.099
252
.071
253
.070
254
.068
255
.065
256
.064
257
.064
258
.064
259
.062
260
.062
261
.062
262
.062
263
.062
264
.062
265
.062
266
.062
267
.062
268
.062
269
.062
270
.062
271
.059
272
.058
273
.058
274
.056
275
.056
276
.056
277
.055
278
.050
279
.049
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021lowpass

Metric: top1