pub struct InstructionInserter { /* private fields */ }Expand description
Processor that prepends a system instruction to every request.
Implementations§
Trait Implementations§
Source§impl RequestProcessor for InstructionInserter
impl RequestProcessor for InstructionInserter
Source§fn process_request<'life0, 'async_trait>(
&'life0 self,
request: LlmRequest,
) -> Pin<Box<dyn Future<Output = Result<LlmRequest, ProcessorError>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
fn process_request<'life0, 'async_trait>(
&'life0 self,
request: LlmRequest,
) -> Pin<Box<dyn Future<Output = Result<LlmRequest, ProcessorError>> + Send + 'async_trait>>where
Self: 'async_trait,
'life0: 'async_trait,
Process the request, potentially modifying it.
Auto Trait Implementations§
impl Freeze for InstructionInserter
impl RefUnwindSafe for InstructionInserter
impl Send for InstructionInserter
impl Sync for InstructionInserter
impl Unpin for InstructionInserter
impl UnwindSafe for InstructionInserter
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more