pub struct RaceTextAgent { /* private fields */ }Expand description
Runs agents concurrently, returns the first to complete. Cancels the rest.
Implementations§
Source§impl RaceTextAgent
impl RaceTextAgent
Sourcepub fn new(
name: impl Into<String>,
agents: Vec<Arc<dyn TextAgent>>,
) -> RaceTextAgent
pub fn new( name: impl Into<String>, agents: Vec<Arc<dyn TextAgent>>, ) -> RaceTextAgent
Create a new race agent that runs agents concurrently and returns the first result.
Sourcepub fn with_middleware_chain(self, chain: MiddlewareChain) -> RaceTextAgent
pub fn with_middleware_chain(self, chain: MiddlewareChain) -> RaceTextAgent
Attach a middleware chain. AgentEvent::AgentStarted is emitted
through it for every contender as the race starts and
AgentEvent::AgentCompleted once, for the winner; losers are cancelled
silently.
Trait Implementations§
Source§impl TextAgent for RaceTextAgent
impl TextAgent for RaceTextAgent
Source§fn run<'life0, 'life1, 'async_trait>(
&'life0 self,
state: &'life1 State,
) -> Pin<Box<dyn Future<Output = Result<String, AgentError>> + Send + 'async_trait>>where
'life0: 'async_trait,
'life1: 'async_trait,
RaceTextAgent: 'async_trait,
fn run<'life0, 'life1, 'async_trait>(
&'life0 self,
state: &'life1 State,
) -> Pin<Box<dyn Future<Output = Result<String, AgentError>> + Send + 'async_trait>>where
'life0: 'async_trait,
'life1: 'async_trait,
RaceTextAgent: 'async_trait,
Execute this agent. Reads/writes
state. Returns the final text output. Read moreSource§fn run_with<'life0, 'life1, 'async_trait>(
&'life0 self,
request: RunRequest,
state: &'life1 State,
) -> Pin<Box<dyn Future<Output = Result<RunResult, AgentError>> + Send + 'async_trait>>where
'life0: 'async_trait,
'life1: 'async_trait,
Self: 'async_trait,
fn run_with<'life0, 'life1, 'async_trait>(
&'life0 self,
request: RunRequest,
state: &'life1 State,
) -> Pin<Box<dyn Future<Output = Result<RunResult, AgentError>> + Send + 'async_trait>>where
'life0: 'async_trait,
'life1: 'async_trait,
Self: 'async_trait,
Run one request and report everything it produced: the reply, the
turns to append to a conversation, token usage and tool calls. Read more
Source§fn run_stream<'a>(
&'a self,
request: RunRequest,
state: State,
) -> Pin<Box<dyn Stream<Item = Result<RunEvent, AgentError>> + Send + 'a>>
fn run_stream<'a>( &'a self, request: RunRequest, state: State, ) -> Pin<Box<dyn Stream<Item = Result<RunEvent, AgentError>> + Send + 'a>>
Run one request as a stream of
RunEvents: text as the model writes
it, each tool call and result, then RunEvent::Finished. Read moreSource§fn stream(
&self,
prompt: impl Into<String>,
) -> Pin<Box<dyn Stream<Item = Result<RunEvent, AgentError>> + Send + '_>>where
Self: Sized,
fn stream(
&self,
prompt: impl Into<String>,
) -> Pin<Box<dyn Stream<Item = Result<RunEvent, AgentError>> + Send + '_>>where
Self: Sized,
Stream the reply to one question, with no history and fresh state. Read more
Source§fn ask<'life0, 'async_trait>(
&'life0 self,
prompt: impl Into<String> + Send + 'async_trait,
) -> Pin<Box<dyn Future<Output = Result<String, AgentError>> + Send + 'async_trait>>where
'life0: 'async_trait,
Self: Sized + 'async_trait,
fn ask<'life0, 'async_trait>(
&'life0 self,
prompt: impl Into<String> + Send + 'async_trait,
) -> Pin<Box<dyn Future<Output = Result<String, AgentError>> + Send + 'async_trait>>where
'life0: 'async_trait,
Self: Sized + 'async_trait,
Ask one question, with no history and fresh state, and get the reply.
Source§fn ask_as<'life0, 'async_trait, T>(
&'life0 self,
prompt: impl Into<String> + Send + 'async_trait,
) -> Pin<Box<dyn Future<Output = Result<T, AgentError>> + Send + 'async_trait>>where
'life0: 'async_trait,
Self: Sized + 'async_trait,
T: DeserializeOwned + JsonSchema + Send + 'async_trait,
fn ask_as<'life0, 'async_trait, T>(
&'life0 self,
prompt: impl Into<String> + Send + 'async_trait,
) -> Pin<Box<dyn Future<Output = Result<T, AgentError>> + Send + 'async_trait>>where
'life0: 'async_trait,
Self: Sized + 'async_trait,
T: DeserializeOwned + JsonSchema + Send + 'async_trait,
Ask one question and get the reply as a
T. Read moreAuto Trait Implementations§
impl Freeze for RaceTextAgent
impl !RefUnwindSafe for RaceTextAgent
impl Send for RaceTextAgent
impl Sync for RaceTextAgent
impl Unpin for RaceTextAgent
impl !UnwindSafe for RaceTextAgent
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
§impl<S> FromSample<S> for S
impl<S> FromSample<S> for S
fn from_sample_(s: S) -> S
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request§impl<L> LayerExt<L> for L
impl<L> LayerExt<L> for L
§fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>where
L: Layer<S>,
fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>where
L: Layer<S>,
Applies the layer to a service and wraps it in [
Layered].