Rank
 

Model
submitted by

average

V1 1 benchmark

V2 1 benchmark

V4 1 benchmark

IT 2 benchmarks

behavior 1 benchmark

engineering 1 benchmark

1
Tiago Marques
.431 .376 .376 .391 .391 .570 .570 .274 .549 X .545 .545
2
Tiago Marques
.427 .374 .374 .261 .261 .580 .580 .424 .551 .297 .497 .497
3
Tiago Marques
.420 .387 .387 .326 .326 .584 .584 .272 .543 X .530 .530 .702 .702
4
Tiago Marques
.419 .375 .375 .334 .334 .582 .582 .270 .540 X .532 .532
5
Martin Schrimpf
.412 .294 .294 .218 .218 .581 .581 .423 .541 .305 .545 .545
6
Brain-Score Team
.408 .347 .347 .341 .341 .610 .610 .248 .496 X .494 .494 .711 .711
7
Joel Dapello
.408 .378 .378 .365 .365 .537 .537 .243 .486 X .515 .515
8
Brain-Score Team
.407 .266 .266 .341 .341 .590 .590 .274 .549 X .561 .561 .764 .764
9
Brain-Score Team
.406 .355 .355 .336 .336 .620 .620 .259 .518 X .461 .461 .715 .715
10
Brain-Score Team
.405 .282 .282 .338 .338 .598 .598 .277 .553 X .533 .533 .768 .768
11
Brain-Score Team
.404 .274 .274 .332 .332 .599 .599 .263 .527 X .555 .555 .774 .774
12
Brain-Score Team
.404 .282 .282 .324 .324 .599 .599 .276 .552 X .541 .541 .746 .746
13
Brain-Score Team
.404 .281 .281 .322 .322 .601 .601 .274 .548 X .543 .543 .759 .759
14
Brain-Score Team
.402 .277 .277 .325 .325 .599 .599 .273 .545 X .537 .537 .772 .772
15
Joel Dapello
.399 .289 .289 .317 .317 .600 .600 .259 .518 X .528 .528 .752 .752
16
Brain-Score Team
.398 .274 .274 .317 .317 .594 .594 .278 .555 X .526 .526 .752 .752
17
Brain-Score Team
.397 .275 .275 .321 .321 .596 .596 .273 .545 X .523 .523 .767 .767
18
Brain-Score Team
.397 .274 .274 .326 .326 .591 .591 .266 .532 X .528 .528 .778 .778
19
Brain-Score Team
.396 .270 .270 .323 .323 .596 .596 .260 .520 X .531 .531 .756 .756
20
Brain-Score Team
.396 .277 .277 .306 .306 .595 .595 .267 .533 X .535 .535 .745 .745
21
Martin Schrimpf
.396 .267 .267 .289 .289 .574 .574 .254 .507 X .594 .594 .854 .854
22
Brain-Score Team
.393 .290 .290 .332 .332 .588 .588 .275 .549 X .480 .480 .680 .680
23
Martin Schrimpf
.392 .271 .271 .312 .312 .586 .586 .241 .481 X .551 .551 .842 .842
24
Brain-Score Team
.392 .284 .284 .313 .313 .587 .587 .270 .539 X .505 .505 .739 .739
25
Violet Xiang
.391 .279 .279 .323 .323 .584 .584 .261 .521 X .509 .509
26
 
.390 .310 .310 .311 .311 .582 .582 .468 .468 .279 .279
27
Brain-Score Team
.390 .274 .274 .302 .302 .583 .583 .266 .531 X .524 .524 .698 .698
28
Joel Dapello
.389 .281 .281 .353 .353 .587 .587 .276 .553 X .448 .448
29
Brain-Score Team
.389 .245 .245 .331 .331 .573 .573 .273 .546 X .521 .521 .718 .718
30
Brain-Score Team
.388 .236 .236 .316 .316 .586 .586 .268 .535 X .533 .533 .698 .698
31
Joel Dapello
.387 .215 .215 .317 .317 .556 .556 .274 .547 X .573 .573
32
Martin Schrimpf
.387 .246 .246 .288 .288 .582 .582 .257 .513 X .561 .561 .822 .822
32
Martin Schrimpf
.387 .246 .246 .288 .288 .582 .582 .257 .513 X .561 .561 .863 .863
34
Brain-Score Team
.386 .253 .253 .332 .332 .575 .575 .271 .543 X .500 .500 .744 .744
35
Violet Xiang
.386 .274 .274 .312 .312 .574 .574 .272 .543 X .499 .499
36
Brain-Score Team
.386 .300 .300 .333 .333 .580 .580 .267 .534 X .448 .448 .602 .602
37
Brain-Score Team
.385 .264 .264 .305 .305 .578 .578 .263 .526 X .515 .515 .829 .829
38
Joel Dapello
.385 .276 .276 .308 .308 .583 .583 .281 .562 X .475 .475
39
Brain-Score Team
.384 .245 .245 .306 .306 .573 .573 .275 .550 X .524 .524 .687 .687
40
Brain-Score Team
.384 .257 .257 .321 .321 .566 .566 .277 .554 X .500 .500 .750 .750
41
Brain-Score Team
.384 .259 .259 .311 .311 .589 .589 .244 .488 X .518 .518 .698 .698
42
Brain-Score Team
.384 .245 .245 .306 .306 .610 .610 .249 .498 X .508 .508 .790 .790
43
Joel Dapello
.383 .246 .246 .339 .339 .549 .549 .279 .559 X .503 .503
44
Joel Dapello
.383 .275 .275 .341 .341 .581 .581 .274 .547 X .445 .445
45
Brain-Score Team
.383 .278 .278 .316 .316 .573 .573 .273 .547 X .473 .473 .664 .664
46
Brain-Score Team
.382 .238 .238 .299 .299 .574 .574 .263 .526 X .537 .537 .802 .802
47
Martin Schrimpf
.382 .263 .263 .302 .302 .587 .587 .250 .499 X .509 .509 .851 .851
48
Brain-Score Team
.381 .233 .233 .319 .319 .583 .583 .272 .543 X .499 .499 .804 .804
49
Joel Dapello
.381 .263 .263 .295 .295 .563 .563 .271 .541 X .513 .513
50
Joel Dapello
.381 .287 .287 .340 .340 .573 .573 .270 .540 X .433 .433
51
Violet Xiang
.380 .290 .290 .324 .324 .555 .555 .254 .508 X .477 .477
52
Joel Dapello
.380 .213 .213 .317 .317 .569 .569 .273 .547 X .526 .526
53
Brain-Score Team
.380 .282 .282 .291 .291 .585 .585 .270 .541 X .470 .470 .827 .827
54
Brain-Score Team
.380 .223 .223 .341 .341 .560 .560 .273 .546 X .502 .502 .709 .709
55
Violet Xiang
.380 .296 .296 .306 .306 .581 .581 .252 .505 X .462 .462
56
Joel Dapello
.379 .228 .228 .286 .286 .575 .575 .272 .543 X .535 .535
57
Violet Xiang
.379 .277 .277 .320 .320 .569 .569 .257 .515 X .472 .472
58
Brain-Score Team
.379 .241 .241 .307 .307 .596 .596 .273 .545 X .477 .477 .780 .780
59
Violet Xiang
.378 .253 .253 .289 .289 .548 .548 .277 .554 X .523 .523
60
Brain-Score Team
.377 .216 .216 .322 .322 .572 .572 .273 .547 X .503 .503 .707 .707
61
Brain-Score Team
.376 .239 .239 .322 .322 .570 .570 .275 .550 X .472 .472 .688 .688
62
Brain-Score Team
.375 .263 .263 .329 .329 .566 .566 .264 .529 X .454 .454 .639 .639
63
Violet Xiang
.373 .283 .283 .301 .301 .569 .569 .267 .534 X .444 .444
64
Joel Dapello
.372 .256 .256 .327 .327 .536 .536 .271 .543 X .471 .471
65
Brain-Score Team
.372 .229 .229 .308 .308 .569 .569 .266 .533 X .488 .488 .654 .654
66
Brain-Score Team
.372 .223 .223 .336 .336 .558 .558 .267 .535 X .477 .477 .684 .684
67
Joel Dapello
.372 .248 .248 .295 .295 .563 .563 .275 .550 X .480 .480
68
Brain-Score Team
.372 .230 .230 .286 .286 .560 .560 .237 .474 X .546 .546 .733 .733
69
Joel Dapello
.371 .238 .238 .334 .334 .570 .570 .267 .534 X .447 .447
70
Violet Xiang
.371 .289 .289 .309 .309 .574 .574 .235 .469 X .446 .446
71
Violet Xiang
.370 .273 .273 .308 .308 .572 .572 .250 .499 X .449 .449
72
Brain-Score Team
.370 .221 .221 .340 .340 .555 .555 .260 .521 X .474 .474 .633 .633
73
Brain-Score Team
.370 .235 .235 .329 .329 .548 .548 .271 .543 X .466 .466 .700 .700
74
Brain-Score Team
.369 .237 .237 .320 .320 .553 .553 .271 .541 X .464 .464 .632 .632
75
 
.369 .325 .325 .353 .353 .551 .551 .268 .535 X .346 .346
76
Mike Ferguson
.368 .316 .316 .353 .353 .550 .550 .254 .508 X .370 .370
77
aalok s
.368 .316 .316 .353 .353 .550 .550 .254 .508 X .370 .370
78
Brain-Score Team
.368 .316 .316 .353 .353 .550 .550 .254 .508 X .370 .370 .577 .577
79
Brain-Score Team
.368 .254 .254 .325 .325 .557 .557 .267 .535 X .437 .437 .652 .652
80
Joel Dapello
.368 .243 .243 .330 .330 .579 .579 .279 .559 X .408 .408
81
Brain-Score Team
.368 .267 .267 .330 .330 .564 .564 .252 .505 X .425 .425 .621 .621
82
Brain-Score Team
.368 .258 .258 .305 .305 .562 .562 .264 .528 X .448 .448 .610 .610
83
Brain-Score Team
.368 .252 .252 .303 .303 .569 .569 .267 .534 X .447 .447 .653 .653
84
Brain-Score Team
.367 .220 .220 .337 .337 .566 .566 .260 .520 X .454 .454 .617 .617
85
Brain-Score Team
.367 .229 .229 .339 .339 .549 .549 .267 .535 X .449 .449 .672 .672
86
Brain-Score Team
.366 .264 .264 .301 .301 .568 .568 .259 .518 X .437 .437 .582 .582
87
Violet Xiang
.364 .271 .271 .267 .267 .548 .548 .258 .515 X .478 .478
88
Brain-Score Team
.363 .256 .256 .332 .332 .530 .530 .257 .514 X .443 .443 .603 .603
89
Violet Xiang
.362 .255 .255 .295 .295 .574 .574 .250 .499 X .433 .433
90
Chengxu Zhuang
.361 .276 .276 .281 .281 .539 .539 .263 .526 X .446 .446
91
Brain-Score Team
.361 .265 .265 .320 .320 .557 .557 .252 .503 X .410 .410 .591 .591
92
Brain-Score Team
.359 .269 .269 .292 .292 .554 .554 .259 .517 X .424 .424 .557 .557
93
Brain-Score Team
.359 .213 .213 .346 .346 .558 .558 .264 .529 X .413 .413 .653 .653
94
Brain-Score Team
.359 .215 .215 .296 .296 .554 .554 .253 .506 X .474 .474 .603 .603
95
Brain-Score Team
.358 .222 .222 .309 .309 .557 .557 .262 .525 X .440 .440 .577 .577
96
Brain-Score Team
.357 .272 .272 .273 .273 .566 .566 .268 .536 X .406 .406 .740 .740
97
Joel Dapello
.355 .247 .247 .278 .278 .565 .565 .276 .552 X .410 .410
98
Violet Xiang
.353 .225 .225 .285 .285 .555 .555 .266 .533 X .435 .435
99
Brain-Score Team
.350 .208 .208 .305 .305 .527 .527 .258 .516 X .451 .451 .588 .588
100
Joel Dapello
.350 .244 .244 .269 .269 .569 .569 .270 .540 X .396 .396
101
Brain-Score Team
.341 .304 .304 .320 .320 .591 .591 .229 .459 X .263 .263 .575 .575
102
Brain-Score Team
.341 .245 .245 .304 .304 .550 .550 .234 .467 X .373 .373 .563 .563
103
Eric Elmoznino
.341 .279 .279 .284 .284 .579 .579 .286 .572 X .276 .276 .001 .001
104
Violet Xiang
.341 .282 .282 .339 .339 .549 .549 .251 .502 X .284 .284
105
Brain-Score Team
.336 .265 .265 .311 .311 .582 .582 .229 .457 X .291 .291 .575 .575
106
Brain-Score Team
.333 .245 .245 .289 .289 .530 .530 .235 .470 X .367 .367 .508 .508
107
Brain-Score Team
.331 .266 .266 .278 .278 .501 .501 .239 .479 X .370 .370 .512 .512
108
Violet Xiang
.330 .273 .273 .315 .315 .588 .588 .252 .504 X .220 .220
109
Paul Mc Grath
.328 .265 .265 .291 .291 .531 .531 .227 .454 X .324 .324
110
Brain-Score Team
.327 .231 .231 .296 .296 .538 .538 .240 .480 X .333 .333 .498 .498
111
Violet Xiang
.324 .209 .209 .248 .248 .515 .515 .225 .450 X .425 .425
112
Paul Mc Grath
.324 .305 .305 .301 .301 .511 .511 .219 .439 X .286 .286
113
Brain-Score Team
.323 .208 .208 .318 .318 .517 .517 .226 .451 X .344 .344 .477 .477
114
Brain-Score Team
.322 .298 .298 .182 .182 .553 .553 .223 .447 X .356 .356 .470 .470
115
Chengxu Zhuang
.321 .243 .243 .318 .318 .550 .550 .262 .524 X .231 .231
116
Paul Mc Grath
.317 .271 .271 .285 .285 .536 .536 .219 .437 X .276 .276
117
Chengxu Zhuang
.314 .253 .253 .308 .308 .563 .563 .268 .536 X .177 .177
118
Paul Mc Grath
.313 .308 .308 .275 .275 .504 .504 .208 .417 X .270 .270
119
Brain-Score Team
.312 .198 .198 .293 .293 .509 .509 .229 .457 X .330 .330 .455 .455
120
Paul Mc Grath
.311 .215 .215 .269 .269 .494 .494 .244 .487 X .333 .333
121
Martin Schrimpf
.307 .215 .215 .260 .260 .550 .550 .200 .401 X .307 .307 .260 .260
122
Violet Xiang
.306 .206 .206 .279 .279 .489 .489 .179 .357 X .376 .376
123
Paul Mc Grath
.304 .234 .234 .261 .261 .485 .485 .204 .408 X .335 .335
124
Brain-Score Team
.303 .183 .183 .249 .249 .501 .501 .230 .460 X .351 .351 .455 .455
125
Brain-Score Team
.302 .262 .262 .238 .238 .513 .513 .213 .425 X .286 .286 .415 .415
126
Paul Mc Grath
.302 .242 .242 .260 .260 .498 .498 .190 .380 X .320 .320
127
Martin Schrimpf
.301 .358 .358 .339 .339 .555 .555 .176 .351 X .078 .078
128
Chengxu Zhuang
.293 .258 .258 .265 .265 .551 .551 .231 .461 X .161 .161
129
Chengxu Zhuang
.292 .267 .267 .294 .294 .548 .548 .261 .522 X .090 .090
130
Violet Xiang
.288 .206 .206 .238 .238 .514 .514 .228 .455 X .256 .256
130
Violet Xiang
.288 .206 .206 .238 .238 .514 .514 .228 .455 X .256 .256
130
Violet Xiang
.288 .206 .206 .238 .238 .514 .514 .228 .455 X .256 .256
130
Violet Xiang
.288 .206 .206 .238 .238 .514 .514 .228 .455 X .256 .256
130
Violet Xiang
.288 .206 .206 .238 .238 .514 .514 .228 .455 X .256 .256
130
Violet Xiang
.288 .206 .206 .238 .238