Scores on benchmarks

Model rank shown below is with respect to all public models.
.437 average_vision rank 4
119 benchmarks
.437
0
ceiling
best
median
.344 neural_vision rank 14
76 benchmarks
.344
0
ceiling
best
median
.427 V1 rank 21
33 benchmarks
.427
0
ceiling
best
median
.378 Allen2022_fmri_surface.V1 rank 27
2 benchmarks
.378
0
ceiling
best
median
.252 Allen2022_fmri_surface.V1-rdm v1 [reference] rank 31
.252
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.504 Allen2022_fmri_surface.V1-ridge v1 [reference] rank 21
.504
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.236 FreemanZiemba2013.V1-pls v3 [reference] rank 220
.236
0
ceiling
best
median
recordings from 102 sites in V1
315 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.611 Hebart2023_fmri.V1-ridgecv v3 rank 26
.611
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.251 Li2026.V1 rank 46
2 benchmarks
.251
0
ceiling
best
median
.117 Li2026.V1-rdm v1 [reference] rank 54
.117
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.384 Li2026.V1-ridgecv v1 [reference] rank 25
.384
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.719 Marques2020 [reference] rank 168
22 benchmarks
.719
0
ceiling
best
median
.747 V1-orientation rank 349
7 benchmarks
.747
0
ceiling
best
median
.958 Marques2020_DeValois1982-pref_or v1 rank 169
.958
0
ceiling
best
median

1152 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.614 Marques2020_Ringach2002-circular_variance v1 rank 382
.614
0
ceiling
best
median

1152 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.912 Marques2020_Ringach2002-cv_bandwidth_ratio v1 rank 87
.912
0
ceiling
best
median

1152 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.813 Marques2020_Ringach2002-opr_cv_diff v1 rank 288
.813
0
ceiling
best
median

1152 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.618 Marques2020_Ringach2002-or_bandwidth v1 rank 369
.618
0
ceiling
best
median

1152 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.731 Marques2020_Ringach2002-or_selective v1 rank 375
.731
0
ceiling
best
median

1152 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.581 Marques2020_Ringach2002-orth_pref_ratio v1 rank 371
.581
0
ceiling
best
median

1152 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.445 V1-receptive_field_size rank 325
2 benchmarks
.445
0
ceiling
best
median
.413 Marques2020_Cavanaugh2002-grating_summation_field v1 [reference] rank 341
.413
0
ceiling
best
median

2304 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.477 Marques2020_Cavanaugh2002-surround_diameter v1 [reference] rank 219
.477
0
ceiling
best
median

2304 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.943 V1-response_magnitude rank 33
3 benchmarks
.943
0
ceiling
best
median
.914 Marques2020_FreemanZiemba2013-max_noise v1 [reference] rank 44
.914
0
ceiling
best
median

450 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.923 Marques2020_FreemanZiemba2013-max_texture v1 [reference] rank 116
.923
0
ceiling
best
median

450 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.992 Marques2020_Ringach2002-max_dc v1 rank 10
.992
0
ceiling
best
median

1152 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.845 V1-response_selectivity rank 2
4 benchmarks
.845
0
ceiling
best
median
.906 Marques2020_FreemanZiemba2013-texture_selectivity v1 [reference] rank 15
.906
0
ceiling
best
median

450 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.873 Marques2020_FreemanZiemba2013-texture_sparseness v1 [reference] rank 21
.873
0
ceiling
best
median

450 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.780 Marques2020_FreemanZiemba2013-texture_variance_ratio v1 [reference] rank 128
.780
0
ceiling
best
median

450 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.822 Marques2020_Ringach2002-modulation_ratio v1 rank 13
.822
0
ceiling
best
median

1152 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.663 V1-spatial_frequency rank 340
3 benchmarks
.663
0
ceiling
best
median
.469 Marques2020_DeValois1982-peak_sf v1 rank 377
.469
0
ceiling
best
median

2112 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.904 Marques2020_Schiller1976-sf_bandwidth v1 [reference] rank 109
.904
0
ceiling
best
median

2112 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.617 Marques2020_Schiller1976-sf_selective v1 [reference] rank 343
.617
0
ceiling
best
median

2112 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.705 V1-surround_modulation rank 140
1 benchmark
.705
0
ceiling
best
median
.705 Marques2020_Cavanaugh2002-surround_suppression_index v1 [reference] rank 140
.705
0
ceiling
best
median

2304 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.682 V1-texture_modulation rank 123
2 benchmarks
.682
0
ceiling
best
median
.578 Marques2020_FreemanZiemba2013-abs_texture_modulation_index v1 [reference] rank 147
.578
0
ceiling
best
median

450 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.786 Marques2020_FreemanZiemba2013-texture_modulation_index v1 [reference] rank 75
.786
0
ceiling
best
median

450 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.822 Papale2025.V1-ridgecv v3 [reference] rank 2
.822
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.055 Coggan2024_fMRI.V1-rdm v1 rank 133
.055
0
ceiling
best
median

24 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.347 Zerbe2026_fmri.V1 [reference] rank 40
3 benchmarks
.347
0
ceiling
best
median
.349 Zerbe2026_fmri.V1-ood-ridgecv v1 [reference] rank 58
.349
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.230 Zerbe2026_fmri.V1-rdm-pearson v1 [reference] rank 46
.230
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.461 Zerbe2026_fmri.V1-tau-ridgecv v1 [reference] rank 22
.461
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.319 V2 rank 15
10 benchmarks
.319
0
ceiling
best
median
.403 Allen2022_fmri_surface.V2 rank 3
2 benchmarks
.403
0
ceiling
best
median
.285 Allen2022_fmri_surface.V2-rdm v1 [reference] rank 18
.285
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.522 Allen2022_fmri_surface.V2-ridge v1 [reference] rank 2
.522
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.254 FreemanZiemba2013.V2-pls v3 [reference] rank 179
.254
0
ceiling
best
median
recordings from 103 sites in V2
315 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.625 Hebart2023_fmri.V2-ridgecv v3 rank 19
.625
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.174 Li2026.V2 rank 41
2 benchmarks
.174
0
ceiling
best
median
.053 Li2026.V2-rdm v1 [reference] rank 63
.053
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.296 Li2026.V2-ridgecv v1 [reference] rank 22
.296
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.094 Coggan2024_fMRI.V2-rdm v1 rank 116
.094
0
ceiling
best
median

24 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.363 Zerbe2026_fmri.V2 [reference] rank 6
3 benchmarks
.363
0
ceiling
best
median
.380 Zerbe2026_fmri.V2-ood-ridgecv v1 [reference] rank 26
.380
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.268 Zerbe2026_fmri.V2-rdm-pearson v1 [reference] rank 15
.268
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.440 Zerbe2026_fmri.V2-tau-ridgecv v1 [reference] rank 6
.440
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.303 V4 rank 44
15 benchmarks
.303
0
ceiling
best
median
.257 Allen2022_fmri_surface.V4 rank 75
2 benchmarks
.257
0
ceiling
best
median
.143 Allen2022_fmri_surface.V4-rdm v1 [reference] rank 78
.143
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.371 Allen2022_fmri_surface.V4-ridge v1 [reference] rank 76
.371
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.268 Hebart2023_fmri.V4-ridgecv v3 rank 93
.268
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.113 Li2026.V4 rank 50
2 benchmarks
.113
0
ceiling
best
median
.084 Li2026.V4-rdm v1 [reference] rank 56
.084
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.141 Li2026.V4-ridgecv v1 [reference] rank 64
.141
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.044 MajajHong2015public.V4-reverse_pls v4 [reference] rank 21
.044
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.530 MajajHong2015.V4-pls v4 [reference] rank 78
.530
0
ceiling
best
median
recordings from 88 sites in V4
2560 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.567 Papale2025.V4-ridgecv v3 [reference] rank 36
.567
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.563 Sanghavi2020.V4-pls v2 [reference] rank 150
.563
0
ceiling
best
median
recordings from 47 sites in V4
5760 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.467 SanghaviJozwik2020.V4-pls v2 [reference] rank 159
.467
0
ceiling
best
median
recordings from 50 sites in V4
4916 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.227 SanghaviMurty2020.V4-pls v2 [reference] rank 95
.227
0
ceiling
best
median
recordings from 46 sites in V4
300 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.036 Coggan2024_fMRI.V4-rdm v1 rank 119
.036
0
ceiling
best
median

24 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.262 Zerbe2026_fmri.V4 [reference] rank 81
3 benchmarks
.262
0
ceiling
best
median
.360 Zerbe2026_fmri.V4-ood-ridgecv v1 [reference] rank 79
.360
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.122 Zerbe2026_fmri.V4-rdm-pearson v1 [reference] rank 73
.122
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.304 Zerbe2026_fmri.V4-tau-ridgecv v1 [reference] rank 77
.304
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.328 IT rank 27
18 benchmarks
.328
0
ceiling
best
median
.410 Allen2022_fmri_surface.IT rank 37
2 benchmarks
.410
0
ceiling
best
median
.278 Allen2022_fmri_surface.IT-rdm v1 [reference] rank 69
.278
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.543 Allen2022_fmri_surface.IT-ridge v1 [reference] rank 17
.543
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.225 Bracci2019.anteriorVTC-rdm v1 rank 177
.225
0
ceiling
best
median

27 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.265 Gifford2022.IT-ridgecv v3 [reference] rank 8
.265
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.337 Hebart2023_fmri.IT-ridgecv v3 rank 11
.337
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.259 Li2026.IT rank 64
2 benchmarks
.259
0
ceiling
best
median
.276 Li2026.IT-rdm v1 [reference] rank 69
.276
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.241 Li2026.IT-ridgecv v1 [reference] rank 46
.241
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.396 MajajHong2015.IT-pls v4 [reference] rank 308
.396
0
ceiling
best
median
recordings from 168 sites in IT
2560 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.039 MajajHong2015public.IT-reverse_pls v4 [reference] rank 93
.039
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.612 Papale2025.IT-ridgecv v3 [reference] rank 3
.612
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.442 Sanghavi2020.IT-pls v2 [reference] rank 248
.442
0
ceiling
best
median
recordings from 88 sites in IT
5760 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.418 SanghaviJozwik2020.IT-pls v2 [reference] rank 223
.418
0
ceiling
best
median
recordings from 26 sites in IT
4916 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.300 SanghaviMurty2020.IT-pls v2 [reference] rank 262
.300
0
ceiling
best
median
recordings from 29 sites in IT
300 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.602 Coggan2024_fMRI.IT-rdm v1 rank 48
.602
0
ceiling
best
median

24 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.293 Zerbe2026_fmri.IT [reference] rank 39
3 benchmarks
.293
0
ceiling
best
median
.231 Zerbe2026_fmri.IT-ood-ridgecv v1 [reference] rank 16
.231
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.345 Zerbe2026_fmri.IT-rdm-pearson v1 [reference] rank 45
.345
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.303 Zerbe2026_fmri.IT-tau-ridgecv v1 [reference] rank 35
.303
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.530 behavior_vision rank 12
43 benchmarks
.530
0
ceiling
best
median
.450 Rajalingham2018-i2n v2 [reference] rank 259
.450
0
ceiling
best
median
match-to-sample task
240 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.590 Geirhos2021-error_consistency [reference] rank 19
17 benchmarks
.590
0
ceiling
best
median
.394 Geirhos2021colour-error_consistency v1 [reference] rank 132
.394
0
ceiling
best
median

640 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.197 Geirhos2021contrast-error_consistency v1 [reference] rank 132
.197
0
ceiling
best
median

800 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.804 Geirhos2021cueconflict-error_consistency v1 [reference] rank 13
.804
0
ceiling
best
median

1280 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.670 Geirhos2021edge-error_consistency v1 [reference] rank 22
.670
0
ceiling
best
median

160 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.548 Geirhos2021eidolonI-error_consistency v1 [reference] rank 55
.548
0
ceiling
best
median

800 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.422 Geirhos2021eidolonII-error_consistency v1 [reference] rank 110
.422
0
ceiling
best
median

640 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.477 Geirhos2021eidolonIII-error_consistency v1 [reference] rank 53
.477
0
ceiling
best
median

480 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.527 Geirhos2021falsecolour-error_consistency v1 [reference] rank 66
.527
0
ceiling
best
median

560 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.721 Geirhos2021highpass-error_consistency v1 [reference] rank 12
.721
0
ceiling
best
median

640 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.520 Geirhos2021lowpass-error_consistency v1 [reference] rank 35
.520
0
ceiling
best
median

800 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.619 Geirhos2021phasescrambling-error_consistency v1 [reference] rank 7
.619
0
ceiling
best
median

640 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.748 Geirhos2021powerequalisation-error_consistency v1 [reference] rank 3
.748
0
ceiling
best
median

560 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.567 Geirhos2021rotation-error_consistency v1 [reference] rank 13
.567
0
ceiling
best
median

960 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.754 Geirhos2021silhouette-error_consistency v1 [reference] rank 59
.754
0
ceiling
best
median

160 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.597 Geirhos2021sketch-error_consistency v1 [reference] rank 23
.597
0
ceiling
best
median

800 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.791 Geirhos2021stylized-error_consistency v1 [reference] rank 5
.791
0
ceiling
best
median

800 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.672 Geirhos2021uniformnoise-error_consistency v1 [reference] rank 15
.672
0
ceiling
best
median

800 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.630 Baker2022 rank 36
3 benchmarks
.630
0
ceiling
best
median
.755 Baker2022fragmented-accuracy_delta v1 [reference] rank 66
.755
0
ceiling
best
median

716 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.134 Baker2022frankenstein-accuracy_delta v1 [reference] rank 160
.134
0
ceiling
best
median

716 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
1.0 Baker2022inverted-accuracy_delta v1 [reference] rank 1
1.0
0
ceiling
best
median

360 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.388 BMD2024 rank 25
4 benchmarks
.388
0
ceiling
best
median
.426 BMD2024.dotted_1Behavioral-accuracy_distance v1 rank 25
.426
0
ceiling
best
median

100 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.250 BMD2024.dotted_2Behavioral-accuracy_distance v1 rank 29
.250
0
ceiling
best
median

100 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.476 BMD2024.texture_1Behavioral-accuracy_distance v1 rank 26
.476
0
ceiling
best
median

100 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.399 BMD2024.texture_2Behavioral-accuracy_distance v1 rank 32
.399
0
ceiling
best
median

100 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.615 Ferguson2024 [reference] rank 30
14 benchmarks
.615
0
ceiling
best
median
.320 Ferguson2024circle_line-value_delta v1 [reference] rank 141
.320
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
1.0 Ferguson2024color-value_delta v1 [reference] rank 1
1.0
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.349 Ferguson2024convergence-value_delta v1 [reference] rank 154
.349
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.882 Ferguson2024eighth-value_delta v1 [reference] rank 15
.882
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.845 Ferguson2024gray_easy-value_delta v1 [reference] rank 26
.845
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.942 Ferguson2024gray_hard-value_delta v1 [reference] rank 28
.942
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.975 Ferguson2024half-value_delta v1 [reference] rank 28
.975
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.017 Ferguson2024juncture-value_delta v1 [reference] rank 245
.017
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.076 Ferguson2024lle-value_delta v1 [reference] rank 264
.076
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.862 Ferguson2024llh-value_delta v1 [reference] rank 57
.862
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.320 Ferguson2024quarter-value_delta v1 [reference] rank 150
.320
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.544 Ferguson2024round_f-value_delta v1 [reference] rank 91
.544
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.820 Ferguson2024round_v-value_delta v1 [reference] rank 59
.820
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.657 Ferguson2024tilted_line-value_delta v1 [reference] rank 111
.657
0
ceiling
best
median
2_way_afc task
48 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.535 Hebart2023-match v1 rank 3
.535
0
ceiling
best
median

1854 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.500 Maniquet2024 rank 174
2 benchmarks
.500
0
ceiling
best
median
.257 Maniquet2024-confusion_similarity v1 [reference] rank 242
.257
0
ceiling
best
median

13600 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.742 Maniquet2024-tasks_consistency v1 [reference] rank 12
.742
0
ceiling
best
median

13600 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.535 Coggan2024_behavior-ConditionWiseAccuracySimilarity v1 rank 41
.535
0
ceiling
best
median

22560 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.272 engineering_vision rank 228
25 benchmarks
.272
0
ceiling
best
median
.822 Geirhos2021-top1 [reference] rank 8
17 benchmarks
.822
0
ceiling
best
median
.995 Geirhos2021colour-top1 v1 [reference] rank 22
.995
0
ceiling
best
median

640 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.995 Geirhos2021contrast-top1 v1 [reference] rank 10
.995
0
ceiling
best
median

800 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.508 Geirhos2021cueconflict-top1 v1 [reference] rank 12
.508
0
ceiling
best
median

1280 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.706 Geirhos2021edge-top1 v1 [reference] rank 34
.706
0
ceiling
best
median

160 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.596 Geirhos2021eidolonI-top1 v1 [reference] rank 24
.596
0
ceiling
best
median

800 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.683 Geirhos2021eidolonII-top1 v1 [reference] rank 5
.683
0
ceiling
best
median

640 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.777 Geirhos2021eidolonIII-top1 v1 [reference] rank 3
.777
0
ceiling
best
median

480 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.995 Geirhos2021falsecolour-top1 v1 [reference] rank 13
.995
0
ceiling
best
median

560 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.981 Geirhos2021highpass-top1 v1 [reference] rank 7
.981
0
ceiling
best
median

640 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.736 Geirhos2021lowpass-top1 v1 [reference] rank 6
.736
0
ceiling
best
median

800 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.928 Geirhos2021phasescrambling-top1 v1 [reference] rank 5
.928
0
ceiling
best
median

640 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.986 Geirhos2021powerequalisation-top1 v1 [reference] rank 6
.986
0
ceiling
best
median

560 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.977 Geirhos2021rotation-top1 v1 [reference] rank 6
.977
0
ceiling
best
median

960 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.719 Geirhos2021silhouette-top1 v1 [reference] rank 7
.719
0
ceiling
best
median

160 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.910 Geirhos2021sketch-top1 v1 [reference] rank 20
.910
0
ceiling
best
median

800 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.673 Geirhos2021stylized-top1 v1 [reference] rank 15
.673
0
ceiling
best
median

800 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.801 Geirhos2021uniformnoise-top1 v1 [reference] rank 12
.801
0
ceiling
best
median

800 images
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.538 Hermann2020 [reference] rank 25
2 benchmarks
.538
0
ceiling
best
median
.599 Hermann2020cueconflict-shape_bias v1 [reference] rank 30
.599
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.478 Hermann2020cueconflict-shape_match v1 [reference] rank 13
.478
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_model
model = load_model("dinov2_vitl14_lc")
model.start_task(...)
model.start_recording(...)
model.look_at(...)

Brain Encoding Response Generator (BERG)

Through the BERG you can easily generate neural responses to images of your choice using any Brain-Score vision model.

For more information on how to use BERG, see the documentation and tutorial.

Historical Trend

Hover the line for a preview; click the chart to pin that month in the sidebar. While pinned, hover does not change it -- use Release or Esc to clear.

Benchmarks bibtex

@article{allen_massive_2022,
    title = {A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence},
    volume = {25},
    issn = {1097-6256},
    doi = {10.1038/s41593-021-00962-x},
    journal = {Nature Neuroscience},
    author = {Allen, Emily J. and St-Yves, Ghislain and Wu, Yihan and Breedlove, Jesse L.
              and Prince, Jacob S. and Dowdle, Logan T. and Nau, Matthias and Caron, Brad
              and Pestilli, Franco and Charest, Ian and Hutchinson, J. Benjamin
              and Naselaris, Thomas and Kay, Kendrick},
    year = {2022},
    pages = {116--126},
}
        @Article{Freeman2013,
                author={Freeman, Jeremy
                and Ziemba, Corey M.
                and Heeger, David J.
                and Simoncelli, Eero P.
                and Movshon, J. Anthony},
                title={A functional and perceptual signature of the second visual area in primates},
                journal={Nature Neuroscience},
                year={2013},
                month={Jul},
                day={01},
                volume={16},
                number={7},
                pages={974-981},
                abstract={The authors examined neuronal responses in V1 and V2 to synthetic texture stimuli that replicate higher-order statistical dependencies found in natural images. V2, but not V1, responded differentially to these textures, in both macaque (single neurons) and human (fMRI). Human detection of naturalistic structure in the same images was predicted by V2 responses, suggesting a role for V2 in representing natural image structure.},
                issn={1546-1726},
                doi={10.1038/nn.3402},
                url={https://doi.org/10.1038/nn.3402}
                }
        @article{li2026triplen,
    title = {Triple-N dataset: large-scale fMRI-guided dense recordings of nonhuman
             primate neural responses to natural scenes},
    author = {Li, Yipeng and Liu, Xieyi and Li, Wanru and Yang, Jia and Gong, Baoqi
              and Jin, Wei and Gong, Zhengxin and Wang, Kesheng and Luo, Jingqiu
              and Zhao, Zishuo and Bao, Pinglei},
    journal = {Nature Neuroscience},
    year = {2026},
    doi = {10.1038/s41593-026-02322-z},
    url = {https://doi.org/10.1038/s41593-026-02322-z},
}
        @article {Marques2021.03.01.433495,
	author = {Marques, Tiago and Schrimpf, Martin and DiCarlo, James J.},
	title = {Multi-scale hierarchical neural network models that bridge from single neurons in the primate primary visual cortex to object recognition behavior},
	elocation-id = {2021.03.01.433495},
	year = {2021},
	doi = {10.1101/2021.03.01.433495},
	publisher = {Cold Spring Harbor Laboratory},
	abstract = {Primate visual object recognition relies on the representations in cortical areas at the top of the ventral stream that are computed by a complex, hierarchical network of neural populations. While recent work has created reasonably accurate image-computable hierarchical neural network models of those neural stages, those models do not yet bridge between the properties of individual neurons and the overall emergent behavior of the ventral stream. One reason we cannot yet do this is that individual artificial neurons in multi-stage models have not been shown to be functionally similar to individual biological neurons. Here, we took an important first step by building and evaluating hundreds of hierarchical neural network models in how well their artificial single neurons approximate macaque primary visual cortical (V1) neurons. We found that single neurons in certain models are surprisingly similar to their biological counterparts and that the distributions of single neuron properties, such as those related to orientation and spatial frequency tuning, approximately match those in macaque V1. Critically, we observed that hierarchical models with V1 stages that better match macaque V1 at the single neuron level are also more aligned with human object recognition behavior. Finally, we show that an optimized classical neuroscientific model of V1 is more functionally similar to primate V1 than all of the tested multi-stage models, suggesting room for further model improvements with tangible payoffs in closer alignment to human behavior. These results provide the first multi-stage, multi-scale models that allow our field to ask precisely how the specific properties of individual V1 neurons relate to recognition behavior.HighlightsImage-computable hierarchical neural network models can be naturally extended to create hierarchical {\textquotedblleft}brain models{\textquotedblright} that allow direct comparison with biological neural networks at multiple scales {\textendash} from single neurons, to population of neurons, to behavior.Single neurons in some of these hierarchical brain models are functionally similar to single neurons in macaque primate visual cortex (V1)Some hierarchical brain models have processing stages in which the entire distribution of artificial neuron properties closely matches the biological distributions of those same properties in macaque V1Hierarchical brain models whose V1 processing stages better match the macaque V1 stage also tend to be more aligned with human object recognition behavior at their output stageCompeting Interest StatementThe authors have declared no competing interest.},
	URL = {https://www.biorxiv.org/content/early/2021/08/13/2021.03.01.433495},
	eprint = {https://www.biorxiv.org/content/early/2021/08/13/2021.03.01.433495.full.pdf},
	journal = {bioRxiv}
}
        @article{Cavanaugh2002,
            author = {Cavanaugh, James R. and Bair, Wyeth and Movshon, J. A.},
            doi = {10.1152/jn.00692.2001},
            isbn = {0022-3077 (Print) 0022-3077 (Linking)},
            issn = {0022-3077},
            journal = {Journal of Neurophysiology},
            mendeley-groups = {Benchmark effects/Done,Benchmark effects/*Surround Suppression},
            number = {5},
            pages = {2530--2546},
            pmid = {12424292},
            title = {{Nature and Interaction of Signals From the Receptive Field Center and Surround in Macaque V1 Neurons}},
            url = {http://www.physiology.org/doi/10.1152/jn.00692.2001},
            volume = {88},
            year = {2002}
            }
        @article{Freeman2013,
            author = {Freeman, Jeremy and Ziemba, Corey M. and Heeger, David J. and Simoncelli, E. P. and Movshon, J. A.},
            doi = {10.1038/nn.3402},
            issn = {10976256},
            journal = {Nature Neuroscience},
            number = {7},
            pages = {974--981},
            pmid = {23685719},
            publisher = {Nature Publishing Group},
            title = {{A functional and perceptual signature of the second visual area in primates}},
            url = {http://dx.doi.org/10.1038/nn.3402},
            volume = {16},
            year = {2013}
            }
        @article{Schiller1976,
            author = {Schiller, P. H. and Finlay, B. L. and Volman, S. F.},
            doi = {10.1152/jn.1976.39.6.1352},
            issn = {0022-3077},
            journal = {Journal of neurophysiology},
            number = {6},
            pages = {1334--1351},
            pmid = {825624},
            title = {{Quantitative studies of single-cell properties in monkey striate cortex. III. Spatial Frequency}},
            url = {http://www.ncbi.nlm.nih.gov/pubmed/825624},
            volume = {39},
            year = {1976}
            }
        @article{papale_extensive_2025,
	title = {An extensive dataset of spiking activity to reveal the syntax of the ventral stream},
	volume = {113},
	issn = {08966273},
	url = {https://linkinghub.elsevier.com/retrieve/pii/S089662732400881X},
	doi = {10.1016/j.neuron.2024.12.003},
	journal = {Neuron},
	author = {Papale, Paolo and Wang, Feng and Self, Matthew W. and Roelfsema, Pieter R.},
	year = {2025},
}
        @inproceedings{santurkar2019computer,
    title={Computer Vision with a Single (Robust) Classifier},
    author={Shibani Santurkar and Dimitris Tsipras and Brandon Tran and Andrew Ilyas and Logan Engstrom and Aleksander Madry},
    booktitle={ArXiv preprint arXiv:1906.09453},
    year={2019}
}
        @inproceedings{zerbe_laion-fmri_2026,
      title = {{LAION}-{fMRI}: A densely sampled 7T-fMRI dataset providing broad coverage of natural image diversity},
      author = {Zerbe, Josefine and Roth, Johannes and Mell, Maggie Mae and Herholz, Peer and Knapen, Tomas and Hebart, Martin N.},
      year = {2026},
      booktitle = {Vision Sciences Society Annual Meeting},
  }
        @article{muzellec_reverse_2026,
      title = {Reverse predictivity for bidirectional comparison of neural networks and biological brains},
      volume = {8},
      issn = {2522-5839},
      url = {https://doi.org/10.1038/s42256-026-01204-0},
      doi = {10.1038/s42256-026-01204-0},
      number = {3},
      journal = {Nature Machine Intelligence},
      author = {Muzellec, Sabine and Kar, Kohitij},
      month = mar,
      year = {2026},
      pages = {474--488},
}
        @article {Majaj13402,
            author = {Majaj, Najib J. and Hong, Ha and Solomon, Ethan A. and DiCarlo, James J.},
            title = {Simple Learned Weighted Sums of Inferior Temporal Neuronal Firing Rates Accurately Predict Human Core Object Recognition Performance},
            volume = {35},
            number = {39},
            pages = {13402--13418},
            year = {2015},
            doi = {10.1523/JNEUROSCI.5181-14.2015},
            publisher = {Society for Neuroscience},
            abstract = {To go beyond qualitative models of the biological substrate of object recognition, we ask: can a single ventral stream neuronal linking hypothesis quantitatively account for core object recognition performance over a broad range of tasks? We measured human performance in 64 object recognition tests using thousands of challenging images that explore shape similarity and identity preserving object variation. We then used multielectrode arrays to measure neuronal population responses to those same images in visual areas V4 and inferior temporal (IT) cortex of monkeys and simulated V1 population responses. We tested leading candidate linking hypotheses and control hypotheses, each postulating how ventral stream neuronal responses underlie object recognition behavior. Specifically, for each hypothesis, we computed the predicted performance on the 64 tests and compared it with the measured pattern of human performance. All tested hypotheses based on low- and mid-level visually evoked activity (pixels, V1, and V4) were very poor predictors of the human behavioral pattern. However, simple learned weighted sums of distributed average IT firing rates exactly predicted the behavioral pattern. More elaborate linking hypotheses relying on IT trial-by-trial correlational structure, finer IT temporal codes, or ones that strictly respect the known spatial substructures of IT ({	extquotedblleft}face patches{	extquotedblright}) did not improve predictive power. Although these results do not reject those more elaborate hypotheses, they suggest a simple, sufficient quantitative model: each object recognition task is learned from the spatially distributed mean firing rates (100 ms) of \~{}60,000 IT neurons and is executed as a simple weighted sum of those firing rates.SIGNIFICANCE STATEMENT We sought to go beyond qualitative models of visual object recognition and determine whether a single neuronal linking hypothesis can quantitatively account for core object recognition behavior. To achieve this, we designed a database of images for evaluating object recognition performance. We used multielectrode arrays to characterize hundreds of neurons in the visual ventral stream of nonhuman primates and measured the object recognition performance of \>100 human observers. Remarkably, we found that simple learned weighted sums of firing rates of neurons in monkey inferior temporal (IT) cortex accurately predicted human performance. Although previous work led us to expect that IT would outperform V4, we were surprised by the quantitative precision with which simple IT-based linking hypotheses accounted for human behavior.},
            issn = {0270-6474},
            URL = {https://www.jneurosci.org/content/35/39/13402},
            eprint = {https://www.jneurosci.org/content/35/39/13402.full.pdf},
            journal = {Journal of Neuroscience}}
        @misc{Sanghavi_DiCarlo_2021,
  title={Sanghavi2020},
  url={osf.io/chwdk},
  DOI={10.17605/OSF.IO/CHWDK},
  publisher={OSF},
  author={Sanghavi, Sachi and DiCarlo, James J},
  year={2021},
  month={Nov}
}
        @misc{Sanghavi_Jozwik_DiCarlo_2021,
  title={SanghaviJozwik2020},
  url={osf.io/fhy36},
  DOI={10.17605/OSF.IO/FHY36},
  publisher={OSF},
  author={Sanghavi, Sachi and Jozwik, Kamila M and DiCarlo, James J},
  year={2021},
  month={Nov}
}
        @misc{Sanghavi_Murty_DiCarlo_2021,
  title={SanghaviMurty2020},
  url={osf.io/fchme},
  DOI={10.17605/OSF.IO/FCHME},
  publisher={OSF},
  author={Sanghavi, Sachi and Murty, N A R and DiCarlo, James J},
  year={2021},
  month={Nov}
}
        @article{gifford_large_2022,
	title = {A large and rich {EEG} dataset for modeling human visual object recognition},
	volume = {264},
	issn = {10538119},
	url = {https://linkinghub.elsevier.com/retrieve/pii/S1053811922008758},
	doi = {10.1016/j.neuroimage.2022.119754},
	journal = {NeuroImage},
	author = {Gifford, Alessandro T. and Dwivedi, Kshitij and Roig, Gemma and Cichy, Radoslaw M.},
	year = {2022},
}
        @Article{Kar2019,
                                                    author={Kar, Kohitij
                                                    and Kubilius, Jonas
                                                    and Schmidt, Kailyn
                                                    and Issa, Elias B.
                                                    and DiCarlo, James J.},
                                                    title={Evidence that recurrent circuits are critical to the ventral stream's execution of core object recognition behavior},
                                                    journal={Nature Neuroscience},
                                                    year={2019},
                                                    month={Jun},
                                                    day={01},
                                                    volume={22},
                                                    number={6},
                                                    pages={974-983},
                                                    abstract={Non-recurrent deep convolutional neural networks (CNNs) are currently the best at modeling core object recognition, a behavior that is supported by the densely recurrent primate ventral stream, culminating in the inferior temporal (IT) cortex. If recurrence is critical to this behavior, then primates should outperform feedforward-only deep CNNs for images that require additional recurrent processing beyond the feedforward IT response. Here we first used behavioral methods to discover hundreds of these `challenge' images. Second, using large-scale electrophysiology, we observed that behaviorally sufficient object identity solutions emerged {	extasciitilde}30{	hinspace}ms later in the IT cortex for challenge images compared with primate performance-matched `control' images. Third, these behaviorally critical late-phase IT response patterns were poorly predicted by feedforward deep CNN activations. Notably, very-deep CNNs and shallower recurrent CNNs better predicted these late IT responses, suggesting that there is a functional equivalence between additional nonlinear transformations and recurrence. Beyond arguing that recurrent circuits are critical for rapid object identification, our results provide strong constraints for future recurrent model development.},
                                                    issn={1546-1726},
                                                    doi={10.1038/s41593-019-0392-5},
                                                    url={https://doi.org/10.1038/s41593-019-0392-5}
                                                    }
        @article {Rajalingham240614,
                author = {Rajalingham, Rishi and Issa, Elias B. and Bashivan, Pouya and Kar, Kohitij and Schmidt, Kailyn and DiCarlo, James J.},
                title = {Large-scale, high-resolution comparison of the core visual object recognition behavior of humans, monkeys, and state-of-the-art deep artificial neural networks},
                elocation-id = {240614},
                year = {2018},
                doi = {10.1101/240614},
                publisher = {Cold Spring Harbor Laboratory},
                abstract = {Primates{	extemdash}including humans{	extemdash}can typically recognize objects in visual images at a glance even in the face of naturally occurring identity-preserving image transformations (e.g. changes in viewpoint). A primary neuroscience goal is to uncover neuron-level mechanistic models that quantitatively explain this behavior by predicting primate performance for each and every image. Here, we applied this stringent behavioral prediction test to the leading mechanistic models of primate vision (specifically, deep, convolutional, artificial neural networks; ANNs) by directly comparing their behavioral signatures against those of humans and rhesus macaque monkeys. Using high-throughput data collection systems for human and monkey psychophysics, we collected over one million behavioral trials for 2400 images over 276 binary object discrimination tasks. Consistent with previous work, we observed that state-of-the-art deep, feed-forward convolutional ANNs trained for visual categorization (termed DCNNIC models) accurately predicted primate patterns of object-level confusion. However, when we examined behavioral performance for individual images within each object discrimination task, we found that all tested DCNNIC models were significantly non-predictive of primate performance, and that this prediction failure was not accounted for by simple image attributes, nor rescued by simple model modifications. These results show that current DCNNIC models cannot account for the image-level behavioral patterns of primates, and that new ANN models are needed to more precisely capture the neural mechanisms underlying primate object vision. To this end, large-scale, high-resolution primate behavioral benchmarks{	extemdash}such as those obtained here{	extemdash}could serve as direct guides for discovering such models.SIGNIFICANCE STATEMENT Recently, specific feed-forward deep convolutional artificial neural networks (ANNs) models have dramatically advanced our quantitative understanding of the neural mechanisms underlying primate core object recognition. In this work, we tested the limits of those ANNs by systematically comparing the behavioral responses of these models with the behavioral responses of humans and monkeys, at the resolution of individual images. Using these high-resolution metrics, we found that all tested ANN models significantly diverged from primate behavior. Going forward, these high-resolution, large-scale primate behavioral benchmarks could serve as direct guides for discovering better ANN models of the primate visual system.},
                URL = {https://www.biorxiv.org/content/early/2018/02/12/240614},
                eprint = {https://www.biorxiv.org/content/early/2018/02/12/240614.full.pdf},
                journal = {bioRxiv}
            }
        @article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }
        @article{BAKER2022104913,
                title = {Deep learning models fail to capture the configural nature of human shape perception},
                journal = {iScience},
                volume = {25},
                number = {9},
                pages = {104913},
                year = {2022},
                issn = {2589-0042},
                doi = {https://doi.org/10.1016/j.isci.2022.104913},
                url = {https://www.sciencedirect.com/science/article/pii/S2589004222011853},
                author = {Nicholas Baker and James H. Elder},
                keywords = {Biological sciences, Neuroscience, Sensory neuroscience},
                abstract = {Summary
                A hallmark of human object perception is sensitivity to the holistic configuration of the local shape features of an object. Deep convolutional neural networks (DCNNs) are currently the dominant models for object recognition processing in the visual cortex, but do they capture this configural sensitivity? To answer this question, we employed a dataset of animal silhouettes and created a variant of this dataset that disrupts the configuration of each object while preserving local features. While human performance was impacted by this manipulation, DCNN performance was not, indicating insensitivity to object configuration. Modifications to training and architecture to make networks more brain-like did not lead to configural processing, and none of the networks were able to accurately predict trial-by-trial human object judgements. We speculate that to match human configural sensitivity, networks must be trained to solve a broader range of object tasks beyond category recognition.}
        }
        @misc{ferguson_ngo_lee_dicarlo_schrimpf_2024,
         title={How Well is Visual Search Asymmetry predicted by a Binary-Choice, Rapid, Accuracy-based Visual-search, Oddball-detection (BRAVO) task?},
         url={osf.io/5ba3n},
         DOI={10.17605/OSF.IO/5BA3N},
         publisher={OSF},
         author={Ferguson, Michael E, Jr and Ngo, Jerry and Lee, Michael and DiCarlo, James and Schrimpf, Martin},
         year={2024},
         month={Jun}
}
        @article {Maniquet2024.04.02.587669,
	author = {Maniquet, Tim and de Beeck, Hans Op and Costantino, Andrea Ivan},
	title = {Recurrent issues with deep neural network models of visual recognition},
	elocation-id = {2024.04.02.587669},
	year = {2024},
	doi = {10.1101/2024.04.02.587669},
	publisher = {Cold Spring Harbor Laboratory},
	URL = {https://www.biorxiv.org/content/early/2024/04/10/2024.04.02.587669},
	eprint = {https://www.biorxiv.org/content/early/2024/04/10/2024.04.02.587669.full.pdf},
	journal = {bioRxiv}
}
        @article{hermann2020origins,
              title={The origins and prevalence of texture bias in convolutional neural networks},
              author={Hermann, Katherine and Chen, Ting and Kornblith, Simon},
              journal={Advances in Neural Information Processing Systems},
              volume={33},
              pages={19000--19015},
              year={2020},
              url={https://proceedings.neurips.cc/paper/2020/hash/db5f9f42a7157abe65bb145000b5871a-Abstract.html}
        }
        

Layer Commitment

Region Layer
V1 backbone.blocks.7
V2 backbone.blocks.11
V4 backbone.blocks.7
IT backbone.blocks.15

Visual Angle

None degrees