Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021contrast-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.998
2
.998
3
.996
4
.996
5
.995
6
.995
7
.994
8
.994
9
.993
10
.993
11
.991
12
.990
13
.990
14
.990
15
.989
16
.989
17
.989
18
.988
19
.988
20
.985
21
.985
22
.985
23
.985
24
.984
25
.984
26
.984
27
.983
28
.981
29
.979
30
.979
31
.978
32
.976
33
.975
34
.974
35
.974
36
.973
37
.973
38
.971
39
.971
40
.968
41
.968
42
.964
43
.964
44
.963
45
.963
46
.958
47
.955
48
.955
49
.955
50
.951
51
.950
52
.949
53
.949
54
.949
55
.948
56
.948
57
.948
58
.946
59
.946
60
.945
61
.945
62
.944
63
.941
64
.940
65
.939
66
.936
67
.934
68
.932
69
.932
70
.924
71
.915
72
.915
73
.915
74
.914
75
.904
76
.900
77
.899
78
.899
79
.891
80
.880
81
.880
82
.880
83
.877
84
.876
85
.873
86
.871
87
.871
88
.871
89
.866
90
.864
91
.864
92
.863
93
.863
94
.860
95
.859
96
.856
97
.855
98
.853
99
.853
100
.845
101
.844
102
.843
103
.840
104
.839
105
.839
106
.830
107
.829
108
.829
109
.823
110
.823
111
.819
112
.816
113
.816
114
.816
115
.816
116
.811
117
.805
118
.804
119
.796
120
.796
121
.796
122
.795
123
.795
124
.795
125
.794
126
.790
127
.781
128
.777
129
.776
130
.776
131
.771
132
.767
133
.766
134
.762
135
.745
136
.738
137
.733
138
.718
139
.713
140
.709
141
.706
142
.706
143
.705
144
.704
145
.703
146
.698
147
.689
148
.688
149
.682
150
.681
151
.680
152
.676
153
.676
154
.674
155
.669
156
.669
157
.669
158
.669
159
.669
160
.667
161
.666
162
.665
163
.662
164
.661
165
.660
166
.660
167
.660
168
.654
169
.652
170
.651
171
.649
172
.647
173
.644
174
.644
175
.642
176
.641
177
.641
178
.640
179
.636
180
.636
181
.631
182
.624
183
.621
184
.619
185
.618
186
.615
187
.608
188
.599
189
.595
190
.590
191
.588
192
.585
193
.584
194
.581
195
.579
196
.579
197
.576
198
.570
199
.569
200
.562
201
.562
202
.556
203
.552
204
.547
205
.544
206
.541
207
.539
208
.539
209
.526
210
.520
211
.507
212
.505
213
.502
214
.501
215
.492
216
.448
217
.439
218
.435
219
.435
220
.435
221
.435
222
.435
223
.435
224
.430
225
.425
226
.420
227
.415
228
.412
229
.395
230
.394
231
.376
232
.369
233
.365
234
.346
235
.343
236
.309
237
.302
238
.302
239
.302
240
.299
241
.282
242
.281
243
.198
244
.195
245
.194
246
.172
247
.124
248
.100
249
.100
250
.083
251
.079
252
.075
253
.072
254
.072
255
.070
256
.069
257
.066
258
.065
259
.064
260
.064
261
.062
262
.062
263
.062
264
.062
265
.062
266
.062
267
.062
268
.062
269
.062
270
.062
271
.062
272
.062
273
.062
274
.062
275
.060
276
.052
277
.041
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021contrast

Metric: top1