brainscore_language

Module Attributes

data_registry

Pool of available data

metric_registry

Pool of available metrics

benchmark_registry

Pool of available benchmarks

model_registry

Pool of available models

Functions

_run_score(model_identifier, ...)

Score the model referenced by the model_identifier on the benchmark referenced by the benchmark_identifier.

load_benchmark(identifier)

load_dataset(identifier)

load_metric(identifier, *args, **kwargs)

load_model(identifier)

score(model_identifier, benchmark_identifier)

Score the model referenced by the model_identifier on the benchmark referenced by the benchmark_identifier.

Modules

artificial_subject

benchmark_helpers

model_helpers

submission

utils