pub struct BoundedPlanExtractor { /* private fields */ }Expand description
Runs an extractor under a deadline and falls back to the deterministic plan.
The deterministic plan is already in the context, so a failed or slow model call costs nothing beyond the deadline itself.
Implementations§
Source§impl BoundedPlanExtractor
impl BoundedPlanExtractor
Sourcepub fn new(inner: Arc<dyn RetrievalPlanExtractor>, timeout: Duration) -> Self
pub fn new(inner: Arc<dyn RetrievalPlanExtractor>, timeout: Duration) -> Self
Bound inner to timeout.
Trait Implementations§
Source§impl RetrievalPlanExtractor for BoundedPlanExtractor
impl RetrievalPlanExtractor for BoundedPlanExtractor
Source§fn extract<'life0, 'async_trait>(
&'life0 self,
context: RetrievalExtractionContext,
) -> Pin<Box<dyn Future<Output = Result<RetrievalPlan, MemoryError>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
fn extract<'life0, 'async_trait>(
&'life0 self,
context: RetrievalExtractionContext,
) -> Pin<Box<dyn Future<Output = Result<RetrievalPlan, MemoryError>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
Extract a plan.
Auto Trait Implementations§
impl Freeze for BoundedPlanExtractor
impl !RefUnwindSafe for BoundedPlanExtractor
impl Send for BoundedPlanExtractor
impl Sync for BoundedPlanExtractor
impl Unpin for BoundedPlanExtractor
impl !UnwindSafe for BoundedPlanExtractor
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
§impl<S> FromSample<S> for S
impl<S> FromSample<S> for S
fn from_sample_(s: S) -> S
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request§impl<L> LayerExt<L> for L
impl<L> LayerExt<L> for L
§fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>where
L: Layer<S>,
fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>where
L: Layer<S>,
Applies the layer to a service and wraps it in [
Layered].