Module case
Expand description
The evaluation case format — JSON trace fixtures for deterministic replay.
Structs§
- LlmTrace
- A complete LLM conversation trace loaded from a JSON fixture.
- Trace
Expects - Declarative expectations for grading a run.
- Trace
Step - A single LLM response step within a turn.
- Trace
Tool Call - A tool call within a trace response.
- Trace
Turn - A single conversation turn (user input + scripted LLM response steps).
Enums§
- Trace
Response - The response content for one step — either plain text or tool calls.
Functions§
- load_
suite - Load every
*.jsontrace fixture indir, sorted by path for stable ordering.