Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021rotation-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.985
2
.969
3
.966
4
.966
5
.964
6
.960
7
.954
8
.953
9
.951
10
.945
11
.945
12
.930
13
.923
14
.922
15
.915
16
.907
17
.904
18
.903
19
.898
20
.896
21
.896
22
.895
23
.892
24
.891
25
.886
26
.886
27
.885
28
.882
29
.876
30
.865
31
.864
32
.864
33
.855
34
.849
35
.846
36
.840
37
.836
38
.835
39
.833
40
.832
41
.829
42
.820
43
.799
44
.797
45
.796
46
.795
47
.795
48
.793
49
.787
50
.780
51
.779
52
.778
53
.778
54
.776
55
.772
56
.771
57
.767
58
.766
59
.765
60
.764
61
.764
62
.760
63
.758
64
.757
65
.752
66
.752
67
.750
68
.748
69
.745
70
.743
71
.742
72
.742
73
.738
74
.738
75
.736
76
.736
77
.734
78
.733
79
.733
80
.730
81
.729
82
.729
83
.729
84
.729
85
.727
86
.727
87
.727
88
.726
89
.725
90
.725
91
.725
92
.724
93
.723
94
.722
95
.720
96
.720
97
.720
98
.719
99
.719
100
.719
101
.718
102
.718
103
.717
104
.716
105
.715
106
.713
107
.713
108
.709
109
.707
110
.705
111
.704
112
.703
113
.702
114
.701
115
.701
116
.701
117
.699
118
.698
119
.696
120
.695
121
.695
122
.694
123
.693
124
.692
125
.692
126
.691
127
.691
128
.691
129
.690
130
.690
131
.689
132
.689
133
.686
134
.685
135
.684
136
.684
137
.684
138
.684
139
.684
140
.684
141
.680
142
.679
143
.678
144
.678
145
.678
146
.676
147
.676
148
.674
149
.673
150
.672
151
.671
152
.670
153
.669
154
.668
155
.667
156
.666
157
.665
158
.665
159
.665
160
.662
161
.662
162
.662
163
.661
164
.661
165
.660
166
.657
167
.656
168
.655
169
.655
170
.655
171
.655
172
.654
173
.654
174
.651
175
.651
176
.648
177
.648
178
.647
179
.645
180
.644
181
.641
182
.640
183
.635
184
.634
185
.633
186
.633
187
.632
188
.631
189
.629
190
.627
191
.626
192
.625
193
.624
194
.623
195
.622
196
.622
197
.618
198
.617
199
.613
200
.613
201
.603
202
.602
203
.601
204
.600
205
.596
206
.594
207
.593
208
.592
209
.592
210
.591
211
.583
212
.583
213
.580
214
.575
215
.574
216
.573
217
.570
218
.570
219
.569
220
.564
221
.561
222
.561
223
.561
224
.561
225
.560
226
.555
227
.544
228
.544
229
.543
230
.536
231
.528
232
.525
233
.523
234
.523
235
.523
236
.520
237
.519
238
.518
239
.517
240
.515
241
.511
242
.502
243
.497
244
.490
245
.489
246
.487
247
.482
248
.482
249
.482
250
.482
251
.482
252
.459
253
.451
254
.447
255
.440
256
.435
257
.425
258
.420
259
.406
260
.405
261
.399
262
.391
263
.355
264
.354
265
.354
266
.354
267
.354
268
.346
269
.297
270
.145
271
.122
272
.079
273
.077
274
.074
275
.074
276
.074
277
.072
278
.071
279
.068
280
.068
281
.064
282
.062
283
.062
284
.062
285
.062
286
.062
287
.062
288
.062
289
.062
290
.062
291
.062
292
.062
293
.062
294
.062
295
.060
296
.060
297
.059
298
.056
299
.054
300
.049
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021rotation

Metric: top1