Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021uniformnoise-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.897
2
.874
3
.873
4
.846
5
.830
6
.821
7
.818
8
.816
9
.811
10
.805
11
.804
12
.801
13
.799
14
.796
15
.792
16
.791
17
.776
18
.776
19
.772
20
.772
21
.765
22
.762
23
.757
24
.750
25
.749
26
.743
27
.743
28
.730
29
.724
30
.720
31
.708
32
.704
33
.701
34
.701
35
.701
36
.700
37
.696
38
.696
39
.693
40
.689
41
.688
42
.686
43
.680
44
.674
45
.671
46
.670
47
.669
48
.657
49
.657
50
.656
51
.656
52
.654
53
.650
54
.649
55
.647
56
.644
57
.644
58
.641
59
.641
60
.632
61
.632
62
.627
63
.627
64
.626
65
.621
66
.621
67
.618
68
.618
69
.618
70
.616
71
.616
72
.613
73
.604
74
.599
75
.595
76
.586
77
.579
78
.578
79
.575
80
.573
81
.571
82
.568
83
.561
84
.560
85
.560
86
.560
87
.560
88
.556
89
.555
90
.554
91
.554
92
.551
93
.549
94
.547
95
.546
96
.542
97
.542
98
.541
99
.540
100
.540
101
.540
102
.539
103
.535
104
.530
105
.530
106
.530
107
.530
108
.524
109
.522
110
.516
111
.515
112
.514
113
.511
114
.511
115
.507
116
.507
117
.506
118
.506
119
.505
120
.505
121
.504
122
.501
123
.501
124
.499
125
.499
126
.499
127
.497
128
.496
129
.496
130
.496
131
.490
132
.487
133
.486
134
.486
135
.486
136
.481
137
.481
138
.480
139
.479
140
.479
141
.477
142
.476
143
.475
144
.475
145
.472
146
.471
147
.469
148
.469
149
.468
150
.466
151
.464
152
.463
153
.461
154
.455
155
.453
156
.449
157
.449
158
.445
159
.445
160
.445
161
.445
162
.443
163
.443
164
.440
165
.440
166
.435
167
.430
168
.427
169
.427
170
.420
171
.417
172
.415
173
.414
174
.410
175
.410
176
.407
177
.406
178
.405
179
.405
180
.404
181
.404
182
.396
183
.395
184
.394
185
.393
186
.384
187
.383
188
.381
189
.380
190
.380
191
.375
192
.374
193
.374
194
.372
195
.371
196
.369
197
.366
198
.366
199
.359
200
.357
201
.355
202
.351
203
.350
204
.350
205
.345
206
.345
207
.344
208
.343
209
.343
210
.343
211
.343
212
.341
213
.340
214
.340
215
.339
216
.339
217
.335
218
.331
219
.330
220
.330
221
.330
222
.329
223
.329
224
.326
225
.326
226
.324
227
.323
228
.323
229
.319
230
.318
231
.318
232
.318
233
.316
234
.315
235
.314
236
.314
237
.311
238
.311
239
.310
240
.310
241
.309
242
.307
243
.305
244
.305
245
.305
246
.305
247
.301
248
.300
249
.294
250
.292
251
.291
252
.291
253
.290
254
.287
255
.285
256
.284
257
.281
258
.273
259
.269
260
.269
261
.269
262
.269
263
.265
264
.259
265
.259
266
.258
267
.256
268
.255
269
.250
270
.247
271
.242
272
.231
273
.230
274
.229
275
.226
276
.221
277
.214
278
.212
279
.211
280
.201
281
.196
282
.194
283
.181
284
.180
285
.177
286
.177
287
.177
288
.177
289
.177
290
.158
291
.117
292
.090
293
.089
294
.087
295
.080
296
.077
297
.076
298
.072
299
.069
300
.066
301
.064
302
.062
303
.062
304
.062
305
.062
306
.062
307
.062
308
.062
309
.062
310
.062
311
.062
312
.062
313
.060
314
.060
315
.059
316
.058
317
.058
318
.058
319
.056
320
.051
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021uniformnoise

Metric: top1