First published on 04-Apr-2024
We are thrilled to introduce Brain-Score 2.0, a major upgrade to the Brain-Score platform
that empowers researchers, developers, and enthusiasts
in the fields of neuroscience, cognitive science, and artificial intelligence
to directly compare computational models of the brain
with human and non-human primate behavior and brain recordings.
Here are the Brain-Score 2.0 features we are most excited about:
Flexibility: new plugin system for easier contribution and collaboration
Brain-Score 2.0 introduces a modular
plugin system
that makes it easy to develop, combine, and contribute data, metrics, benchmarks, and models.
Researchers can now more easily submit their own components and stress-test leading models
or submit their own state-of-the-art model.
Accessibility: enhanced website and documentation
Brain-Score’s web presence got a facelift.
Our revamped website provides an improved user experience with more intuitive navigation,
a simplified leaderboard, and detailed
tutorials.
We believe that making the platform easier to use is crucial for fostering collaboration and innovation.
Language: broadening to a new domain
Brain-Score 2.0 introduces Brain-Score Language,
which extends the Brain-Score platform from modeling the visual ventral stream to the human language
system.
The addition of Brain-Score Language reflects our philosophy that
the Brain-Score approach to model benchmarking is fundamentally domain agnostic,
and represents a step toward a future multimodal Brain-Score.
Brain-Score benchmarking competition
In 2022, we organized the first Brain-Score competition for model submissions which were tested
on our existing benchmarks and led to new state-of-the-art models of the primate visual ventral stream.
In 2024 — we have turned the table!
This year, in the spirit of an adversarial collaboration — we invite experimentalists and the community at
large
to turn their legitimate concerns into concrete benchmarks that will challenge and
hopefully expose the explanatory gaps between our current models of primate vision and the biological brain.