Scores on benchmarks

Model rank shown below is with respect to all public models.
.00 average_vision rank 491
81 benchmarks
.00
0
ceiling
best
median
.01 neural_vision rank 482
38 benchmarks
.01
0
ceiling
best
median
.02 V1 rank 475
24 benchmarks
.02
0
ceiling
best
median
.07 Coggan2024_fMRI.V1-rdm v1 rank 78
.07
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.00 V2 rank 483
2 benchmarks
.00
0
ceiling
best
median
.00 Coggan2024_fMRI.V2-rdm v1 rank 225
.00
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_vision import load_model
model = load_model("SeLaVi-Kinetics400")
model.start_task(...)
model.start_recording(...)
model.look_at(...)

Benchmarks bibtex

@inproceedings{santurkar2019computer,
    title={Computer Vision with a Single (Robust) Classifier},
    author={Shibani Santurkar and Dimitris Tsipras and Brandon Tran and Andrew Ilyas and Logan Engstrom and Aleksander Madry},
    booktitle={ArXiv preprint arXiv:1906.09453},
    year={2019}
}
        @article{geirhos2021partial,
              title={Partial success in closing the gap between human and machine vision},
              author={Geirhos, Robert and Narayanappa, Kantharaju and Mitzkus, Benjamin and Thieringer, Tizian and Bethge, Matthias and Wichmann, Felix A and Brendel, Wieland},
              journal={Advances in Neural Information Processing Systems},
              volume={34},
              year={2021},
              url={https://openreview.net/forum?id=QkljT4mrfs}
        }
        @misc{ferguson_ngo_lee_dicarlo_schrimpf_2024,
         title={How Well is Visual Search Asymmetry predicted by a Binary-Choice, Rapid, Accuracy-based Visual-search, Oddball-detection (BRAVO) task?},
         url={osf.io/5ba3n},
         DOI={10.17605/OSF.IO/5BA3N},
         publisher={OSF},
         author={Ferguson, Michael E, Jr and Ngo, Jerry and Lee, Michael and DiCarlo, James and Schrimpf, Martin},
         year={2024},
         month={Jun}
}
        

Layer Commitment

Region Layer
V1 base.layer4
V2 base.layer3

Visual Angle

None degrees