flexeval.rubric#

Rubric metric IO utilities. Should maybe be moved to io.

Functions

`get_default_rubric_collection`()
`load_rubric_metrics`(rubric_collections[, ...])
`load_rubrics_from_yaml_file`(path)
`load_rubrics_from_yaml_stream`(stream)

flexeval.rubric.get_default_rubric_collection() → RubricsCollection[source]#

flexeval.rubric.load_rubric_metrics(rubric_collections: list[Path | RubricsCollection], add_defaults: bool = False) → dict[str, Rubric][source]#

flexeval.rubric.load_rubrics_from_yaml_file(path: Path) → dict[str, Rubric][source]#

flexeval.rubric.load_rubrics_from_yaml_stream(stream) → dict[str, Rubric][source]#