Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021rotation-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.985
2
.969
3
.966
4
.966
5
.964
6
.960
7
.954
8
.953
9
.951
10
.945
11
.945
12
.930
13
.923
14
.922
15
.907
16
.904
17
.903
18
.898
19
.896
20
.896
21
.895
22
.892
23
.891
24
.886
25
.886
26
.885
27
.882
28
.865
29
.864
30
.864
31
.855
32
.849
33
.846
34
.840
35
.836
36
.835
37
.833
38
.832
39
.829
40
.799
41
.796
42
.795
43
.795
44
.793
45
.787
46
.780
47
.779
48
.778
49
.776
50
.772
51
.771
52
.767
53
.766
54
.765
55
.764
56
.764
57
.760
58
.758
59
.757
60
.752
61
.752
62
.750
63
.745
64
.743
65
.742
66
.742
67
.738
68
.736
69
.736
70
.734
71
.733
72
.733
73
.729
74
.729
75
.729
76
.729
77
.727
78
.726
79
.725
80
.725
81
.725
82
.724
83
.723
84
.722
85
.720
86
.720
87
.719
88
.719
89
.719
90
.718
91
.718
92
.713
93
.709
94
.705
95
.704
96
.702
97
.701
98
.701
99
.699
100
.698
101
.696
102
.695
103
.695
104
.694
105
.693
106
.692
107
.692
108
.691
109
.691
110
.691
111
.690
112
.690
113
.689
114
.685
115
.684
116
.684
117
.684
118
.684
119
.684
120
.684
121
.680
122
.678
123
.678
124
.678
125
.676
126
.676
127
.674
128
.673
129
.672
130
.671
131
.670
132
.669
133
.668
134
.667
135
.666
136
.665
137
.665
138
.665
139
.662
140
.662
141
.662
142
.661
143
.661
144
.660
145
.657
146
.656
147
.655
148
.655
149
.655
150
.655
151
.654
152
.654
153
.651
154
.651
155
.648
156
.648
157
.647
158
.645
159
.644
160
.641
161
.635
162
.634
163
.633
164
.633
165
.632
166
.631
167
.629
168
.627
169
.626
170
.625
171
.624
172
.623
173
.622
174
.618
175
.617
176
.613
177
.613
178
.603
179
.602
180
.601
181
.600
182
.596
183
.594
184
.593
185
.592
186
.592
187
.591
188
.583
189
.583
190
.580
191
.575
192
.574
193
.573
194
.570
195
.570
196
.569
197
.564
198
.561
199
.561
200
.561
201
.561
202
.560
203
.555
204
.544
205
.544
206
.543
207
.536
208
.528
209
.523
210
.523
211
.523
212
.520
213
.519
214
.518
215
.517
216
.515
217
.511
218
.502
219
.497
220
.490
221
.489
222
.487
223
.482
224
.482
225
.482
226
.482
227
.482
228
.482
229
.482
230
.482
231
.482
232
.479
233
.459
234
.451
235
.447
236
.440
237
.435
238
.425
239
.420
240
.406
241
.405
242
.399
243
.391
244
.355
245
.354
246
.346
247
.297
248
.145
249
.122
250
.079
251
.077
252
.074
253
.074
254
.074
255
.072
256
.071
257
.068
258
.068
259
.064
260
.062
261
.062
262
.062
263
.062
264
.062
265
.062
266
.062
267
.062
268
.062
269
.062
270
.060
271
.060
272
.059
273
.056
274
.054
275
.049
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021rotation

Metric: top1