flexeval.classes.eval_runner#

class flexeval.classes.eval_runner.EvalRunner(evalrun: EvalRun)[source]#

Class for maintaining database connection, logs, and run state Does not need to write anything to database itself.

Methods

`initialize_database`()	Initializes database and tables.
`initialize_logger`([add_stream_handler])	Configure the logger for this class.
`load_evaluation_settings`()	This function parses our eval suite and puts it in the data structure we'll need for easy use at run-time.