Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021stylized-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.910
2
.910
3
.786
4
.786
5
.786
6
.786
7
.748
8
.716
9
.716
10
.713
11
.708
12
.700
13
.695
14
.690
15
.672
16
.664
17
.657
18
.655
19
.654
20
.654
21
.650
22
.649
23
.649
24
.644
25
.641
26
.637
27
.631
28
.627
29
.613
30
.609
31
.605
32
.599
33
.599
34
.599
35
.595
36
.594
37
.594
38
.588
39
.586
40
.574
41
.571
42
.571
43
.568
44
.566
45
.566
46
.566
47
.561
48
.559
49
.559
50
.557
51
.557
52
.556
53
.551
54
.547
55
.546
56
.546
57
.546
58
.544
59
.544
60
.540
61
.521
62
.521
63
.515
64
.514
65
.512
66
.492
67
.492
68
.485
69
.482
70
.481
71
.476
72
.475
73
.466
74
.466
75
.464
76
.464
77
.458
78
.455
79
.450
80
.450
81
.450
82
.448
83
.445
84
.444
85
.441
86
.441
87
.440
88
.440
89
.438
90
.434
91
.431
92
.430
93
.427
94
.427
95
.426
96
.426
97
.426
98
.425
99
.424
100
.422
101
.422
102
.421
103
.420
104
.420
105
.420
106
.419
107
.419
108
.419
109
.417
110
.416
111
.416
112
.416
113
.415
114
.414
115
.412
116
.410
117
.410
118
.410
119
.410
120
.410
121
.410
122
.409
123
.409
124
.409
125
.407
126
.407
127
.407
128
.407
129
.407
130
.406
131
.404
132
.404
133
.404
134
.403
135
.401
136
.401
137
.401
138
.401
139
.400
140
.400
141
.400
142
.399
143
.399
144
.399
145
.399
146
.399
147
.398
148
.398
149
.398
150
.398
151
.398
152
.395
153
.395
154
.395
155
.393
156
.393
157
.390
158
.389
159
.388
160
.386
161
.386
162
.386
163
.386
164
.386
165
.385
166
.385
167
.384
168
.384
169
.383
170
.383
171
.381
172
.381
173
.381
174
.380
175
.379
176
.379
177
.379
178
.378
179
.378
180
.378
181
.375
182
.374
183
.372
184
.371
185
.371
186
.371
187
.371
188
.371
189
.371
190
.370
191
.370
192
.369
193
.367
194
.367
195
.366
196
.366
197
.366
198
.366
199
.365
200
.364
201
.361
202
.360
203
.359
204
.359
205
.359
206
.356
207
.356
208
.355
209
.355
210
.354
211
.354
212
.352
213
.352
214
.352
215
.352
216
.351
217
.351
218
.351
219
.350
220
.347
221
.346
222
.346
223
.346
224
.345
225
.344
226
.344
227
.343
228
.341
229
.341
230
.341
231
.340
232
.338
233
.338
234
.335
235
.331
236
.331
237
.329
238
.329
239
.328
240
.325
241
.325
242
.321
243
.315
244
.315
245
.312
246
.312
247
.311
248
.309
249
.306
250
.306
251
.305
252
.305
253
.302
254
.302
255
.301
256
.297
257
.290
258
.289
259
.287
260
.282
261
.279
262
.279
263
.279
264
.279
265
.279
266
.265
267
.265
268
.263
269
.255
270
.254
271
.253
272
.251
273
.241
274
.184
275
.160
276
.087
277
.084
278
.083
279
.072
280
.070
281
.070
282
.068
283
.066
284
.065
285
.065
286
.065
287
.064
288
.062
289
.062
290
.062
291
.062
292
.062
293
.062
294
.062
295
.062
296
.062
297
.062
298
.059
299
.058
300
.058
301
.055
302
.050
303
.045
304
.044
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021stylized

Metric: top1