pub struct EvalSetFile {
pub name: String,
pub eval_cases: Vec<EvalCaseFile>,
}Expand description
Top-level structure of a .evalset.json file.
Fields§
§name: StringName of the evaluation set.
eval_cases: Vec<EvalCaseFile>The evaluation cases.
Implementations§
Source§impl EvalSetFile
impl EvalSetFile
Sourcepub fn to_eval_pairs(&self) -> Vec<(Vec<Invocation>, Vec<Invocation>)>
pub fn to_eval_pairs(&self) -> Vec<(Vec<Invocation>, Vec<Invocation>)>
Convert this file representation into evaluator-compatible super::Invocation pairs.
Returns (actual_invocations, expected_invocations) for each eval case.
Actual invocations are built from intermediate_data when present,
falling back to user content only. Expected invocations are built from
expected_tool_use and expected_response.
Trait Implementations§
Source§impl Clone for EvalSetFile
impl Clone for EvalSetFile
Source§fn clone(&self) -> EvalSetFile
fn clone(&self) -> EvalSetFile
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for EvalSetFile
impl Debug for EvalSetFile
Source§impl<'de> Deserialize<'de> for EvalSetFile
impl<'de> Deserialize<'de> for EvalSetFile
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Auto Trait Implementations§
impl Freeze for EvalSetFile
impl RefUnwindSafe for EvalSetFile
impl Send for EvalSetFile
impl Sync for EvalSetFile
impl Unpin for EvalSetFile
impl UnwindSafe for EvalSetFile
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more