Skip to content

scandeval.data_loading

source module scandeval.data_loading

Functions related to the loading of the data.

Functions

  • load_data — Load the raw bootstrapped datasets.

source load_data(rng: Generator, dataset_config: DatasetConfig, benchmark_config: BenchmarkConfig) → list[DatasetDict]

Load the raw bootstrapped datasets.

Parameters

  • rng : Generator —

    The random number generator to use.

  • dataset_config : DatasetConfig —

    The configuration for the dataset.

  • benchmark_config : BenchmarkConfig —

    The configuration for the benchmark.

Returns

  • list[DatasetDict] — A list of bootstrapped datasets, one for each iteration.

Raises