Struct LlmAsJudge 

pub struct LlmAsJudge { /* private fields */ }

Evaluator that uses an LLM to judge agent responses.

Sends the actual and expected invocations to an LLM along with a rubric, and parses the score from the LLM’s response.

Implementations

impl LlmAsJudge

pub fn new(llm: Arc<dyn BaseLlm>, config: LlmAsJudgeConfig) -> Self

Create a new LLM-as-judge evaluator.

Trait Implementations

impl Evaluator for LlmAsJudge

fn evaluate<'life0, 'life1, 'life2, 'async_trait>( &'life0 self, actual: &'life1 [Invocation], expected: Option<&'life2 [Invocation]>, ) -> Pin<Box<dyn Future<Output = Result<EvalResult, EvalError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait, 'life2: 'async_trait,

Evaluate agent invocations.