Create evaluation

Create Evaluations

Once your project is set up, the next step is to create an evaluation where session data can be analyzed. Evaluations act as containers for imported sessions and are the starting point for applying evaluators.

Steps to create an evaluation:

1. On the Session Evaluation page, click Create Evaluation.

   

2. Enter a name for your Evaluation.

3. Select the data source for your evaluation and click Create:

   • Production Data – Sessions generated by real users in your deployed Agentic apps.
   • Simulated Data – Sessions generated from one or more simulation runs.
   

After you create the evaluation, it appears in the Evaluations list, where you can Import data, configure evaluators, and start analysis.