Struct LlmTextAgent 

pub struct LlmTextAgent { /* private fields */ }

Core text agent — calls BaseLlm::generate(), dispatches tools, loops until the model produces a final text response.

Middleware hooks fire at each lifecycle point:

• before_model / after_model — wraps each BaseLlm::generate() call; before_model may return a cached response to skip the LLM entirely.
• before_tool / after_tool / on_tool_error — wraps each tool dispatch.
• on_error — called when run() is about to return an error.

Note: before_agent/after_agent are Live-session hooks that require an InvocationContext (a Live WebSocket concept) and are therefore not invoked by LlmTextAgent. Use before_model or wrap in a custom TextAgent if you need entry/exit hooks for the text path.

Implementations

impl LlmTextAgent

pub fn new(name: impl Into<String>, llm: Arc<dyn BaseLlm>) -> LlmTextAgent

Create a new LLM text agent.

pub fn instruction(self, inst: impl Into<String>) -> LlmTextAgent

Set the system instruction.

pub fn instruction_provider( self, provider: impl InstructionProvider + 'static, ) -> LlmTextAgent

Set a dynamic instruction source — an InstructionProvider (any Fn(&State) -> String closure, or a TemplateInstruction under the templates feature) resolved against session state at the start of every run. Wins over instruction.

pub fn llm_provider<F>(self, provider: F) -> LlmTextAgent

where F: Fn(&State) -> Arc<dyn BaseLlm> + Send + Sync + 'static,

Set a dynamic model source, resolved against session state at the start of every run — risk-based escalation to a stronger model, cost routing to a cheaper one, per-tenant model selection — without rebuilding the agent. Wins over the constructor’s model when set.

pub fn tools(self, dispatcher: Arc<ToolDispatcher>) -> LlmTextAgent

Set the tool dispatcher.

pub fn temperature(self, t: f32) -> LlmTextAgent

Set temperature.

pub fn max_output_tokens(self, n: u32) -> LlmTextAgent

Set max output tokens.

pub fn add_middleware(self, mw: Arc<dyn Middleware>) -> LlmTextAgent

Append a middleware layer to the chain.

Layers are run in insertion order for before_* / on_error hooks and in reverse insertion order for after_* hooks (outermost last).

pub fn with_middleware_chain(self, chain: MiddlewareChain) -> LlmTextAgent

Replace the entire middleware chain (advanced — prefer add_middleware).

Trait Implementations

impl TextAgent for LlmTextAgent

fn name(&self) -> &str

Human-readable name for logging and debugging.

fn run<'life0, 'life1, 'async_trait>( &'life0 self, state: &'life1 State, ) -> Pin<Box<dyn Future<Output = Result<String, AgentError>> + Send + 'async_trait>>

where 'life0: 'async_trait, 'life1: 'async_trait, LlmTextAgent: 'async_trait,

Execute this agent. Reads/writes state. Returns the final text output.