Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021rotation-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.985
2
.969
3
.966
4
.966
5
.964
6
.960
7
.954
8
.953
9
.951
10
.945
11
.945
12
.930
13
.923
14
.922
15
.907
16
.904
17
.903
18
.898
19
.896
20
.896
21
.895
22
.892
23
.891
24
.886
25
.886
26
.885
27
.882
28
.865
29
.864
30
.864
31
.855
32
.849
33
.846
34
.840
35
.836
36
.835
37
.833
38
.832
39
.829
40
.799
41
.796
42
.795
43
.795
44
.793
45
.787
46
.780
47
.779
48
.778
49
.776
50
.772
51
.771
52
.767
53
.766
54
.765
55
.764
56
.764
57
.760
58
.758
59
.757
60
.752
61
.752
62
.750
63
.745
64
.743
65
.742
66
.742
67
.738
68
.736
69
.736
70
.734
71
.733
72
.733
73
.729
74
.729
75
.729
76
.729
77
.727
78
.726
79
.725
80
.725
81
.725
82
.724
83
.723
84
.722
85
.720
86
.720
87
.719
88
.719
89
.719
90
.718
91
.718
92
.713
93
.709
94
.705
95
.704
96
.702
97
.701
98
.701
99
.699
100
.698
101
.696
102
.695
103
.695
104
.694
105
.693
106
.692
107
.692
108
.691
109
.691
110
.691
111
.690
112
.690
113
.689
114
.685
115
.684
116
.684
117
.684
118
.684
119
.684
120
.684
121
.680
122
.679
123
.678
124
.678
125
.678
126
.676
127
.676
128
.674
129
.673
130
.672
131
.671
132
.670
133
.669
134
.668
135
.667
136
.666
137
.665
138
.665
139
.665
140
.662
141
.662
142
.662
143
.661
144
.661
145
.660
146
.657
147
.656
148
.655
149
.655
150
.655
151
.655
152
.654
153
.654
154
.651
155
.651
156
.648
157
.648
158
.647
159
.645
160
.644
161
.641
162
.635
163
.634
164
.633
165
.633
166
.632
167
.631
168
.629
169
.627
170
.626
171
.625
172
.624
173
.623
174
.622
175
.618
176
.617
177
.613
178
.613
179
.603
180
.602
181
.601
182
.600
183
.596
184
.594
185
.593
186
.592
187
.592
188
.591
189
.583
190
.583
191
.580
192
.575
193
.574
194
.573
195
.570
196
.570
197
.569
198
.564
199
.561
200
.561
201
.561
202
.561
203
.560
204
.555
205
.544
206
.544
207
.543
208
.536
209
.528
210
.523
211
.523
212
.523
213
.520
214
.519
215
.518
216
.517
217
.515
218
.511
219
.502
220
.497
221
.490
222
.489
223
.487
224
.482
225
.482
226
.482
227
.482
228
.482
229
.482
230
.482
231
.482
232
.482
233
.482
234
.482
235
.482
236
.482
237
.479
238
.459
239
.451
240
.447
241
.440
242
.435
243
.425
244
.420
245
.406
246
.405
247
.399
248
.391
249
.355
250
.354
251
.354
252
.354
253
.354
254
.346
255
.297
256
.145
257
.122
258
.079
259
.077
260
.074
261
.074
262
.074
263
.072
264
.071
265
.068
266
.068
267
.064
268
.062
269
.062
270
.062
271
.062
272
.062
273
.062
274
.062
275
.062
276
.062
277
.062
278
.062
279
.062
280
.062
281
.060
282
.060
283
.059
284
.056
285
.054
286
.049
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021rotation

Metric: top1