Struct LlmRequest 

pub struct LlmRequest {
    pub contents: Vec<Content>,
    pub model: Option<String>,
    pub system_instruction: Option<String>,
    pub tools: Vec<Tool>,
    pub temperature: Option<f32>,
    pub max_output_tokens: Option<u32>,
    pub top_p: Option<f32>,
    pub top_k: Option<u32>,
    pub stop_sequences: Vec<String>,
    pub thinking_budget: Option<u32>,
    pub response_mime_type: Option<String>,
    pub response_json_schema: Option<Value>,
}

Configuration for an LLM generation request.

Every field a provider can honour is here, and GeminiLlm sends every one of them. New fields may be added; build requests with ..Default::default() or LlmRequest::from_text.

Fields

contents: Vec<Content>

The messages/contents to send.

model: Option<String>

The model for this request, overriding the provider’s default model (e.g. "gemini-2.5-pro"). None uses BaseLlm::model_id.

system_instruction: Option<String>

System instruction.

tools: Vec<Tool>

Available tools.

temperature: Option<f32>

Temperature for generation.

max_output_tokens: Option<u32>

Maximum output tokens.

top_p: Option<f32>

Nucleus sampling threshold.

top_k: Option<u32>

Number of highest-probability tokens to sample from.

stop_sequences: Vec<String>

Strings that end generation when produced.

thinking_budget: Option<u32>

Token budget for the model’s thinking, on models that think.

response_mime_type: Option<String>

MIME type for structured output (e.g., "application/json").

response_json_schema: Option<Value>

JSON Schema for structured output. Requires response_mime_type = "application/json".

Implementations

impl LlmRequest

pub fn from_text(text: impl Into<String>) -> LlmRequest

Create a request from a single user message.

pub fn from_contents(contents: Vec<Content>) -> LlmRequest

Create a request from existing contents.

Trait Implementations

impl Clone for LlmRequest

fn clone(&self) -> LlmRequest

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlmRequest

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.

impl Default for LlmRequest

fn default() -> LlmRequest

Returns the “default value” for a type.

impl<'de> Deserialize<'de> for LlmRequest

fn deserialize<__D>( __deserializer: __D, ) -> Result<LlmRequest, <__D as Deserializer<'de>>::Error>

where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer.

impl Serialize for LlmRequest

fn serialize<__S>( &self, __serializer: __S, ) -> Result<<__S as Serializer>::Ok, <__S as Serializer>::Error>

where __S: Serializer,

Serialize this value into the given Serde serializer.