Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021rotation-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.985
2
.969
3
.966
4
.966
5
.964
6
.960
7
.954
8
.953
9
.951
10
.945
11
.945
12
.930
13
.923
14
.922
15
.907
16
.904
17
.903
18
.898
19
.896
20
.896
21
.895
22
.892
23
.891
24
.886
25
.886
26
.885
27
.882
28
.865
29
.864
30
.864
31
.855
32
.849
33
.846
34
.840
35
.836
36
.835
37
.833
38
.832
39
.829
40
.799
41
.796
42
.795
43
.795
44
.793
45
.787
46
.780
47
.779
48
.778
49
.776
50
.772
51
.771
52
.767
53
.766
54
.765
55
.764
56
.764
57
.760
58
.758
59
.757
60
.752
61
.752
62
.750
63
.745
64
.743
65
.742
66
.742
67
.738
68
.736
69
.736
70
.734
71
.733
72
.733
73
.729
74
.729
75
.729
76
.729
77
.727
78
.726
79
.725
80
.725
81
.725
82
.724
83
.723
84
.722
85
.720
86
.720
87
.719
88
.719
89
.719
90
.718
91
.718
92
.713
93
.709
94
.705
95
.704
96
.702
97
.701
98
.701
99
.699
100
.698
101
.696
102
.695
103
.695
104
.694
105
.693
106
.692
107
.692
108
.691
109
.691
110
.691
111
.690
112
.690
113
.689
114
.685
115
.684
116
.684
117
.684
118
.684
119
.684
120
.684
121
.680
122
.679
123
.678
124
.678
125
.678
126
.676
127
.676
128
.674
129
.673
130
.672
131
.671
132
.670
133
.669
134
.668
135
.667
136
.666
137
.665
138
.665
139
.665
140
.662
141
.662
142
.662
143
.661
144
.661
145
.660
146
.657
147
.656
148
.655
149
.655
150
.655
151
.655
152
.654
153
.654
154
.651
155
.651
156
.648
157
.648
158
.647
159
.645
160
.644
161
.641
162
.635
163
.634
164
.633
165
.633
166
.632
167
.631
168
.629
169
.627
170
.626
171
.625
172
.624
173
.623
174
.622
175
.618
176
.617
177
.613
178
.613
179
.603
180
.602
181
.601
182
.600
183
.596
184
.594
185
.593
186
.592
187
.592
188
.591
189
.583
190
.583
191
.580
192
.575
193
.574
194
.573
195
.570
196
.570
197
.569
198
.564
199
.561
200
.561
201
.561
202
.561
203
.560
204
.555
205
.544
206
.544
207
.543
208
.536
209
.528
210
.523
211
.523
212
.523
213
.520
214
.519
215
.518
216
.517
217
.515
218
.511
219
.502
220
.497
221
.490
222
.489
223
.487
224
.482
225
.482
226
.482
227
.482
228
.482
229
.482
230
.482
231
.482
232
.482
233
.479
234
.459
235
.451
236
.447
237
.440
238
.435
239
.425
240
.420
241
.406
242
.405
243
.399
244
.391
245
.355
246
.354
247
.346
248
.297
249
.145
250
.122
251
.079
252
.077
253
.074
254
.074
255
.074
256
.072
257
.071
258
.068
259
.068
260
.064
261
.062
262
.062
263
.062
264
.062
265
.062
266
.062
267
.062
268
.062
269
.062
270
.062
271
.060
272
.060
273
.059
274
.056
275
.054
276
.049
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021rotation

Metric: top1