Sample stimuli
How to use
from brainscore_language import load_benchmark
benchmark = load_benchmark("Futrell2018-pearsonr")
score = benchmark(my_model)
Model scores
Min Alignment
Max Alignment
|
Rank |
Model |
Score |
|---|---|---|
| 1 |
.387
|
|
| 2 |
.367
|
|
| 3 |
.361
|
|
| 4 |
.358
|
|
| 5 |
.350
|
|
| 6 |
.331
|
|
| 7 |
.324
|
|
| 8 |
.318
|
|
| 9 |
.308
|
|
| 10 |
.286
|
|
| 11 |
|
|
| 12 |
|
|
| 13 |
|
|
| 14 |
nan
|
Benchmark bibtex
@proceedings{futrell2018natural,
title={The Natural Stories Corpus},
author={Futrell, Richard and Gibson, Edward and Tily, Harry J. and Blank, Idan and Vishnevetsky, Anastasia and
Piantadosi, Steven T. and Fedorenko, Evelina},
conference={International Conference on Language Resources and Evaluation (LREC)},
url={http://www.lrec-conf.org/proceedings/lrec2018/pdf/337.pdf},
year={2018}
}
Ceiling
0.86.Note that scores are relative to this ceiling.
Data: Futrell2018
Metric: pearsonr