.. _basic:

Basic usage
===========

This vignette demonstrates basic usage of FlexEval. We configure a single FileDataSource - a JSONL file containing one conversation. We compute a single function metric: the index of each message within a thread. This trivial example demonstrates the necessary objects for running an Eval and accessing the resulting metrics. Other vignettes build on this basic approach to compute more complex metrics.

Python source: ``basic.py``

.. literalinclude:: ../../../vignettes/basic.py
   :language: python
   :linenos:
   :lines: 8-
   :lineno-start: 1

``conversations.jsonl`` contents:

.. literalinclude:: ../../../vignettes/conversations.jsonl
   :language: python
   :linenos: