pub struct EvalCriterion { /* private fields */ }Expand description
An evaluation criterion applied to agent output.
Implementations§
Source§impl EvalCriterion
impl EvalCriterion
Sourcepub fn score(&self, output: &str, expected: &str) -> f64
pub fn score(&self, output: &str, expected: &str) -> f64
Synchronously score the output against expected (0.0–1.0). LLM-judge
criteria cannot run on the sync path and return 1.0 here — use
EvalCriterion::score_async for those.
Sourcepub async fn score_async(&self, output: &str, expected: &str) -> f64
pub async fn score_async(&self, output: &str, expected: &str) -> f64
Score the output, running an LLM judge if this is a judge criterion.
A judge criterion scores 1.0 when no violation is flagged, else 0.0.
Trait Implementations§
Source§impl BitOr<EvalCriterion> for EvalComposite
impl BitOr<EvalCriterion> for EvalComposite
Source§type Output = EvalComposite
type Output = EvalComposite
The resulting type after applying the
| operator.Source§impl BitOr for EvalCriterion
Compose two criteria with |.
impl BitOr for EvalCriterion
Compose two criteria with |.
Source§type Output = EvalComposite
type Output = EvalComposite
The resulting type after applying the
| operator.Source§impl Clone for EvalCriterion
impl Clone for EvalCriterion
Source§fn clone(&self) -> EvalCriterion
fn clone(&self) -> EvalCriterion
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for EvalCriterion
impl Debug for EvalCriterion
Source§impl From<EvalCriterion> for EvalComposite
A single criterion is a one-element composite, so
E::suite().criteria(E::response_match()) works without an explicit |.
impl From<EvalCriterion> for EvalComposite
A single criterion is a one-element composite, so
E::suite().criteria(E::response_match()) works without an explicit |.
Source§fn from(criterion: EvalCriterion) -> Self
fn from(criterion: EvalCriterion) -> Self
Converts to this type from the input type.
Auto Trait Implementations§
impl Freeze for EvalCriterion
impl !RefUnwindSafe for EvalCriterion
impl Send for EvalCriterion
impl Sync for EvalCriterion
impl Unpin for EvalCriterion
impl !UnwindSafe for EvalCriterion
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<S> FromSample<S> for S
impl<S> FromSample<S> for S
fn from_sample_(s: S) -> S
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request§impl<L> LayerExt<L> for L
impl<L> LayerExt<L> for L
§fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>where
L: Layer<S>,
fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>where
L: Layer<S>,
Applies the layer to a service and wraps it in [
Layered].