Skip to main content
Ctrl+K

FlexEval

  • Getting started
  • User guide
  • Vignettes
  • API
  • Getting started
  • User guide
  • Vignettes
  • API

Section Navigation

  • flexeval
    • flexeval.classes
      • flexeval.classes.base
      • flexeval.classes.dataset
      • flexeval.classes.eval_runner
      • flexeval.classes.eval_set_run
      • flexeval.classes.message
      • flexeval.classes.metric
      • flexeval.classes.thread
      • flexeval.classes.tool_call
      • flexeval.classes.turn
    • flexeval.cli
    • flexeval.completions
    • flexeval.compute_metrics
    • flexeval.configuration
      • flexeval.configuration.completion_functions
      • flexeval.configuration.function_metrics
    • flexeval.data_loader
    • flexeval.db_utils
    • flexeval.dependency_graph
    • flexeval.function_types
    • flexeval.helpers
    • flexeval.io
    • flexeval.log_utils
    • flexeval.metrics
      • flexeval.metrics.access
      • flexeval.metrics.save
    • flexeval.rubric
    • flexeval.run_utils
    • flexeval.runner
    • flexeval.schema
      • flexeval.schema.config_schema
      • flexeval.schema.eval_schema
      • flexeval.schema.evalrun_schema
      • flexeval.schema.rubric_schema
      • flexeval.schema.schema_utils

Indices

  • General Index
  • Python Module Index
  • API
  • flexeval
  • flexeval.run_utils

flexeval.run_utils#

Utilities for runner.

Functions

build_datasets(runner, evalsetrun)

build_eval_set_run(runner)

flexeval.run_utils.build_datasets(runner: EvalRunner, evalsetrun: EvalSetRun)[source]#
flexeval.run_utils.build_eval_set_run(runner: EvalRunner) → EvalSetRun[source]#

previous

flexeval.rubric

next

flexeval.runner
On this page
  • build_datasets()
  • build_eval_set_run()
Edit on GitHub

This Page

  • Show Source

© Copyright 2025, Digital Harbor Foundation.

Created using Sphinx 8.1.3.

Built with the PyData Sphinx Theme 0.16.1.