SessionTelemetry

Struct SessionTelemetry 

Source
pub struct SessionTelemetry { /* private fields */ }
Expand description

Zero-overhead telemetry collector for speech-to-speech sessions.

Designed for the three-lane processor model:

  • Fast lane (sync, <1ms): No telemetry calls — pure audio/text forwarding.
  • Telemetry lane (async, debounced): Calls record_* methods on every event. These use only atomic operations — no allocations, no locks, no syscalls.
  • Control lane (async): Calls snapshot() at turn boundaries to get aggregated stats as a JSON value ready to send to the browser.

Implementations§

Source§

impl SessionTelemetry

Source

pub fn new() -> SessionTelemetry

Create a new telemetry tracker, starting the session clock.

Source

pub fn record_audio_out(&self, byte_len: usize) -> Option<Duration>

Record an outgoing audio chunk. Called from the telemetry lane.

Returns the response latency when this chunk is the model’s first output after the user’s end of speech (or text send) — once per turn, via a CAS so only the first chunk wins.

Source

pub fn record_vad_end(&self)

Record VAD end (user stopped speaking).

Source

pub fn record_text_send(&self)

Record that user sent a text message (for text-input latency tracking).

Source

pub fn record_text_out(&self) -> Option<Duration>

Record first model text output (TextDelta). Tracks text-input latency.

Returns the response latency when this delta is the model’s first output after a text send.

Source

pub fn record_interruption(&self)

Record an interruption (barge-in).

Source

pub fn record_turn_complete(&self)

Record turn completion for duration tracking.

Source

pub fn record_usage( &self, total: Option<u32>, prompt: Option<u32>, response: Option<u32>, cached: Option<u32>, thoughts: Option<u32>, )

Record token usage from a UsageMetadata event.

Source

pub fn mark_turn_start(&self)

Mark the beginning of a new turn (e.g., when model starts responding).

Source

pub fn latency(&self) -> LatencyStats

Per-turn response latency: end of user speech (or text send) to the model’s first output, as a distribution over the session so far.

Cheap enough to call once per turn (it sorts at most LATENCY_RECENT_WINDOW samples); not for the audio hot path.

Source

pub fn snapshot(&self) -> Value

Snapshot all metrics as a JSON value.

The flat *_response_latency_ms keys are kept for existing dashboards; response_latency carries the full LatencyStats (percentiles and histogram included).

Trait Implementations§

Source§

impl Default for SessionTelemetry

Source§

fn default() -> SessionTelemetry

Returns the “default value” for a type. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<S> FromSample<S> for S

§

fn from_sample_(s: S) -> S

§

impl<T> FutureExt for T

§

fn with_context(self, otel_cx: Context) -> WithContext<Self>

Attaches the provided Context to this type, returning a WithContext wrapper. Read more
§

fn with_current_context(self) -> WithContext<Self>

Attaches the current Context to this type, returning a WithContext wrapper. Read more
§

impl<T> FutureExt for T

§

fn with_context(self, otel_cx: Context) -> WithContext<Self>

Attaches the provided Context to this type, returning a WithContext wrapper. Read more
§

fn with_current_context(self) -> WithContext<Self>

Attaches the current Context to this type, returning a WithContext wrapper. Read more
§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
§

impl<T> IntoRequest<T> for T

§

fn into_request(self) -> Request<T>

Wrap the input message T in a tonic::Request
§

impl<L> LayerExt<L> for L

§

fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>
where L: Layer<S>,

Applies the layer to a service and wraps it in [Layered].
§

impl<T> Pointable for T

§

const ALIGN: usize

The alignment of pointer.
§

type Init = T

The type for initializers.
§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
§

impl<T> PolicyExt for T
where T: ?Sized,

§

fn and<P, B, E>(self, other: P) -> And<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns [Action::Follow] only if self and other return Action::Follow. Read more
§

fn or<P, B, E>(self, other: P) -> Or<T, P>
where T: Policy<B, E>, P: Policy<B, E>,

Create a new Policy that returns [Action::Follow] if either self or other returns Action::Follow. Read more
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
§

impl<T, U> ToSample<U> for T
where U: FromSample<T>,

§

fn to_sample_(self) -> U

Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<S, T> Duplex<S> for T
where T: FromSample<S> + ToSample<S>,

§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,