Sample stimuli

sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_benchmark
benchmark = load_benchmark("Geirhos2021rotation-top1")
score = benchmark(my_model)

Model scores

Min Alignment Max Alignment

Rank

Model

Score

1
.985
2
.969
3
.966
4
.966
5
.964
6
.960
7
.954
8
.953
9
.951
10
.945
11
.945
12
.930
13
.923
14
.922
15
.907
16
.904
17
.903
18
.898
19
.896
20
.896
21
.895
22
.892
23
.891
24
.886
25
.886
26
.885
27
.882
28
.865
29
.864
30
.864
31
.855
32
.849
33
.846
34
.840
35
.836
36
.835
37
.833
38
.832
39
.829
40
.799
41
.796
42
.795
43
.795
44
.793
45
.787
46
.780
47
.779
48
.778
49
.778
50
.776
51
.772
52
.771
53
.767
54
.766
55
.765
56
.764
57
.764
58
.760
59
.758
60
.757
61
.752
62
.752
63
.750
64
.745
65
.743
66
.742
67
.742
68
.738
69
.736
70
.736
71
.734
72
.733
73
.733
74
.729
75
.729
76
.729
77
.729
78
.727
79
.726
80
.725
81
.725
82
.725
83
.724
84
.723
85
.722
86
.720
87
.720
88
.719
89
.719
90
.719
91
.718
92
.718
93
.713
94
.709
95
.705
96
.704
97
.703
98
.702
99
.701
100
.701
101
.699
102
.698
103
.696
104
.695
105
.695
106
.694
107
.693
108
.692
109
.692
110
.691
111
.691
112
.691
113
.690
114
.690
115
.689
116
.685
117
.684
118
.684
119
.684
120
.684
121
.684
122
.684
123
.680
124
.679
125
.678
126
.678
127
.678
128
.676
129
.676
130
.674
131
.673
132
.672
133
.671
134
.670
135
.669
136
.668
137
.667
138
.666
139
.665
140
.665
141
.665
142
.662
143
.662
144
.662
145
.661
146
.661
147
.660
148
.657
149
.656
150
.655
151
.655
152
.655
153
.655
154
.654
155
.654
156
.651
157
.651
158
.648
159
.648
160
.647
161
.645
162
.644
163
.641
164
.635
165
.634
166
.633
167
.633
168
.632
169
.631
170
.629
171
.627
172
.626
173
.625
174
.624
175
.623
176
.622
177
.618
178
.617
179
.613
180
.613
181
.603
182
.602
183
.601
184
.600
185
.596
186
.594
187
.593
188
.592
189
.592
190
.591
191
.583
192
.583
193
.580
194
.575
195
.574
196
.573
197
.570
198
.570
199
.569
200
.564
201
.561
202
.561
203
.561
204
.561
205
.560
206
.555
207
.544
208
.544
209
.543
210
.536
211
.528
212
.523
213
.523
214
.523
215
.520
216
.519
217
.518
218
.517
219
.515
220
.511
221
.502
222
.497
223
.490
224
.489
225
.487
226
.482
227
.482
228
.482
229
.482
230
.482
231
.459
232
.451
233
.447
234
.440
235
.435
236
.425
237
.420
238
.406
239
.405
240
.399
241
.391
242
.355
243
.354
244
.354
245
.354
246
.354
247
.346
248
.297
249
.145
250
.122
251
.079
252
.077
253
.074
254
.074
255
.074
256
.072
257
.071
258
.068
259
.068
260
.064
261
.062
262
.062
263
.062
264
.062
265
.062
266
.062
267
.062
268
.062
269
.062
270
.062
271
.062
272
.062
273
.062
274
.060
275
.060
276
.059
277
.056
278
.054
279
.049
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427

Benchmark bibtex

@article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }

Ceiling

1.00.

Note that scores are relative to this ceiling.

Data: Geirhos2021rotation

Metric: top1