scandeval.dataset_configs

source module scandeval.dataset_configs

All dataset configurations used in ScandEval.

Functions

• get_all_dataset_configs — Get a mapping of all the dataset configurations.

• get_dataset_config — Get the dataset configuration for a dataset.

source get_all_dataset_configs() → dict[str, DatasetConfig]

Get a mapping of all the dataset configurations.

Returns

• dict[str, DatasetConfig] — A mapping between names of datasets and their configurations.

source get_dataset_config(dataset_name: str) → DatasetConfig

Get the dataset configuration for a dataset.

Parameters

• dataset_name : str —

  The name of the dataset.

Returns

• DatasetConfig — The dataset configuration.

Raises

• ValueError —

  If the dataset is not found.