Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021rotation-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.989
2
.986
3
.985
4
.983
5
.979
6
.977
7
.976
8
.975
9
.969
10
.969
11
.966
12
.966
13
.965
14
.964
15
.960
16
.955
17
.954
18
.953
19
.951
20
.945
21
.945
22
.930
23
.923
24
.922
25
.919
26
.915
27
.907
28
.904
29
.903
30
.898
31
.896
32
.896
33
.895
34
.892
35
.891
36
.886
37
.886
38
.885
39
.882
40
.876
41
.865
42
.864
43
.864
44
.855
45
.849
46
.846
47
.840
48
.836
49
.835
50
.833
51
.832
52
.829
53
.820
54
.799
55
.797
56
.796
57
.795
58
.795
59
.793
60
.787
61
.780
62
.779
63
.778
64
.778
65
.776
66
.772
67
.771
68
.767
69
.766
70
.765
71
.764
72
.764
73
.760
74
.758
75
.757
76
.752
77
.752
78
.750
79
.745
80
.743
81
.742
82
.742
83
.738
84
.736
85
.736
86
.734
87
.733
88
.733
89
.729
90
.729
91
.729
92
.729
93
.727
94
.727
95
.727
96
.726
97
.725
98
.725
99
.725
100
.724
101
.723
102
.722
103
.720
104
.720
105
.720
106
.719
107
.719
108
.719
109
.718
110
.718
111
.713
112
.709
113
.707
114
.705
115
.704
116
.703
117
.702
118
.701
119
.701
120
.699
121
.698
122
.697
123
.696
124
.695
125
.695
126
.694
127
.693
128
.692
129
.692
130
.691
131
.691
132
.691
133
.690
134
.690
135
.689
136
.689
137
.685
138
.684
139
.684
140
.684
141
.684
142
.684
143
.684
144
.680
145
.679
146
.678
147
.678
148
.678
149
.676
150
.676
151
.674
152
.673
153
.672
154
.671
155
.670
156
.669
157
.668
158
.667
159
.666
160
.665
161
.665
162
.665
163
.662
164
.662
165
.662
166
.661
167
.661
168
.660
169
.657
170
.656
171
.655
172
.655
173
.655
174
.655
175
.654
176
.654
177
.651
178
.651
179
.648
180
.648
181
.647
182
.645
183
.644
184
.641
185
.640
186
.635
187
.634
188
.633
189
.633
190
.632
191
.631
192
.629
193
.627
194
.626
195
.625
196
.624
197
.623
198
.622
199
.622
200
.618
201
.617
202
.613
203
.613
204
.603
205
.602
206
.601
207
.600
208
.596
209
.594
210
.593
211
.592
212
.592
213
.591
214
.583
215
.583
216
.580
217
.575
218
.574
219
.573
220
.570
221
.570
222
.569
223
.564
224
.561
225
.561
226
.561
227
.561
228
.560
229
.555
230
.544
231
.544
232
.543
233
.536
234
.528
235
.525
236
.523
237
.523
238
.523
239
.520
240
.519
241
.518
242
.517
243
.515
244
.511
245
.502
246
.497
247
.490
248
.489
249
.487
250
.482
251
.482
252
.482
253
.482
254
.482
255
.459
256
.451
257
.447
258
.440
259
.435
260
.425
261
.420
262
.406
263
.405
264
.399
265
.391
266
.355
267
.354
268
.354
269
.354
270
.354
271
.346
272
.297
273
.145
274
.122
275
.079
276
.077
277
.074
278
.074
279
.074
280
.072
281
.071
282
.068
283
.068
284
.064
285
.062
286
.062
287
.062
288
.062
289
.062
290
.062
291
.062
292
.062
293
.062
294
.062
295
.062
296
.060
297
.060
298
.059
299
.056
300
.054
301
.049
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021rotation

Metric: top1