scandeval.model_config

source module scandeval.model_config

Functions related to getting the model configuration.

Functions

• get_model_config — Fetches configuration for a model.

source get_model_config(model_id: str, benchmark_config: BenchmarkConfig) → ModelConfig

Fetches configuration for a model.

Parameters

• model_id : str —

  The model ID.

• benchmark_config : BenchmarkConfig —

  The configuration of the benchmark.

Returns

• ModelConfig — The model configuration.

Raises

• InvalidModel —

  If all model setups can handle the model, but the model does not exist.