Scores on benchmarks

Model rank shown below is with respect to all public models.
.479 average_language rank 13
5 benchmarks
.479
0
ceiling
best
median
.958 neural_language rank 5
4 benchmarks
.958
0
ceiling
best
median
1.0 Pereira2018-linear rank 1
2 benchmarks
1.0
0
ceiling
best
median
1.0 Pereira2018.243sentences-linear v1 rank 1
1.0
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
1.0 Pereira2018.384sentences-linear v1 rank 1
1.0
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
1.0 Fedorenko2016-linear_pearsonr v3 rank 1
1.0
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9
.873 Fedorenko2016-ridge_pearsonr v3 rank 6
.873
0
ceiling
best
median
sample 0 sample 1 sample 2 sample 3 sample 4 sample 5 sample 6 sample 7 sample 8 sample 9

How to use

from brainscore_language import load_model
model = load_model("falcon-7b")
model.start_task(...)
model.start_recording(...)
model.look_at(...)

Brain Encoding Response Generator (BERG)

Through the BERG you can easily generate neural responses to text sentences of your choice using any Brain-Score language model.

For more information on how to use BERG, see the documentation and tutorial.

Benchmarks bibtex


                

Layer Commitment

No layer commitments found for this model. Older submissions might not have stored this information but will be updated when evaluated on new benchmarks.

Visual Angle

None degrees