Struct RubricEvaluator 

pub struct RubricEvaluator { /* private fields */ }

Evaluator that scores agent outputs against free-text rubric criteria using an LLM as judge.

Implementations

impl RubricEvaluator

pub fn new(rubrics: Vec<String>) -> Self

Create a new rubric evaluator with the given rubric criteria.

pub fn for_response(rubrics: Vec<String>) -> Self

Create a rubric evaluator for final response quality.

Uses the rubric_based_final_response_quality_v1 evaluation strategy.

pub fn for_tool_use(rubrics: Vec<String>) -> Self

Create a rubric evaluator for tool use quality.

Uses the rubric_based_tool_use_quality_v1 evaluation strategy.

pub fn with_judge_model(self, model: impl Into<String>) -> Self

Set an override judge model name.

pub fn with_llm(self, llm: Arc<dyn BaseLlm>) -> Self

Provide an LLM instance for performing evaluations.

Trait Implementations

impl Evaluator for RubricEvaluator

fn evaluate<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, actual: &'life1 [Invocation], expected: Option<&'life2 [Invocation]>, ) -> Pin<Box<dyn Future<Output = Result<EvalResult, EvalError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Evaluate agent invocations.