Struct GatewayDecisionModel 

pub struct GatewayDecisionModel { /* private fields */ }

A decision model served by Vercel AI Gateway, such as TypeSafe AI’s Jev.

Authenticates with AI_GATEWAY_API_KEY, or with a VERCEL_OIDC_TOKEN (what vercel env pull writes and what deployments on Vercel receive).

use gemini_adk_rs::decision::{DecisionModel, DecisionRequest, GatewayDecisionModel, Question};
use serde_json::json;

let jev = GatewayDecisionModel::from_env()?;
let response = jev
    .decide(DecisionRequest::new(
        json!({ "caller": "Yes, please book it." }),
        [("confirmed", Question::boolean("Did the caller agree to book?"))],
    ))
    .await?;
println!("{:?} in {:?}", response.answers["confirmed"], response.latency);

Implementations

impl GatewayDecisionModel

pub const DEFAULT_BASE_URL: &'static str = "https://ai-gateway.vercel.sh"

AI Gateway’s address.

pub const JEV: &'static str = "typesafe-ai/jev"

TypeSafe AI’s Jev, the default model.

pub const DEFAULT_TIMEOUT: Duration

How long a decision may take before the call fails.

pub fn new(model: impl Into<String>, token: impl Into<String>) -> Self

A client for model, authenticating with token.

pub fn from_env() -> Result<Self, LlmError>

A client configured from the environment:

Variable	Use
AI_GATEWAY_API_KEY, else VERCEL_OIDC_TOKEN	Credential (required)
AI_GATEWAY_DECISION_MODEL	Model, default typesafe-ai/jev
AI_GATEWAY_BASE_URL	Gateway address, default https://ai-gateway.vercel.sh

pub fn with_base_url(self, base_url: impl Into<String>) -> Self

Use another Gateway address (a proxy, or a local server in tests).

pub fn with_timeout(self, timeout: Duration) -> Self

Fail a decision that takes longer than timeout.

pub fn zero_data_retention(self, on: bool) -> Self

Ask the Gateway to route only to providers with zero data retention.

pub fn only_providers<S: Into<String>>( self, providers: impl IntoIterator<Item = S>, ) -> Self

Restrict which providers may serve the model.

pub fn fallback(self, model: impl Into<String>, when: FallbackWhen) -> Self

Rerun the decision with model when when matches the primary answers (a Gateway decision fallback). model may be a language model, which answers through structured output and reports no confidence. Both stages are billed and their latencies add.

pub fn body(&self, request: &DecisionRequest) -> Value

The request body for request.

pub fn parse( status: u16, body: &str, latency: Duration, ) -> Result<DecisionResponse, LlmError>

Read a /v1/evaluate response.

Trait Implementations

impl Clone for GatewayDecisionModel

fn clone(&self) -> GatewayDecisionModel

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for GatewayDecisionModel

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl DecisionModel for GatewayDecisionModel

fn model_id(&self) -> &str

The model’s identifier, such as typesafe-ai/jev.

fn decide<'life0, 'async_trait>( &'life0 self, request: DecisionRequest, ) -> Pin<Box<dyn Future<Output = Result<DecisionResponse, LlmError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Answer request’s questions.