Brain-Score is a platform to evaluate computational models of mind and brain function on their match to behavioral and
neural measurements in domains such as vision and language. The intent of Brain-Score is to adopt many (ideally all) the
experimental benchmarks in the field for the purpose of model testing, falsification, and comparison. To that end,
Brain-Score operationalizes experimental data into quantitative benchmarks that any model candidate following
the BrainModel interface can be scored on.
See the Documentation for more details.
Brain-Score is made by and for the community. To contribute, please send in a pull request.
brainscore_core.metadata contains the YAML contract, source policy, conversion,
and review checks used by the website and domain workflows. It is included in
the normal core distribution; no separate metadata package needs publishing.
Importing metadata does not load core's scoring modules. Existing imports of
Metric, Score, and Benchmark remain supported and load on demand.
python -m pip install .
python -m brainscore_core.metadata.cli --help
python -m brainscore_core.metadata.review --help
python -m unittest discover -s tests/test_metadata -vConsumers install core from a full approved Git commit SHA supplied through
METADATA_CORE_REF. Merge the core changes before configuring that pin in the
website build and domain workflows. Keep metadata publication disabled until
database migrations, review protections, and the dev rehearsal are complete.
MIT license