Scores on benchmarks

Model rank shown below is with respect to all public models.
.083 average_language rank 25
5 benchmarks
.083
0
ceiling
best
median
.167 neural_language rank 25
4 benchmarks
.167
0
ceiling
best
median
.500 Pereira2018-linear rank 23
2 benchmarks
.500
0
ceiling
best
median
1.0 Pereira2018.243sentences-linear v1 rank 1
1.0
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_language import load_model
model = load_model("falcon-40b")
model.start_task(...)
model.start_recording(...)
model.look_at(...)

Brain Encoding Response Generator (BERG)

Through the BERG you can easily generate neural responses to text sentences of your choice using any Brain-Score language model.

For more information on how to use BERG, see the documentation and tutorial.

Benchmarks bibtex


                

Layer Commitment

No layer commitments found for this model. Older submissions might not have stored this information but will be updated when evaluated on new benchmarks.

Visual Angle

None degrees