DEFAULT_COMPRESSION_TARGET_TOKENS

Constant DEFAULT_COMPRESSION_TARGET_TOKENS 

Source
pub const DEFAULT_COMPRESSION_TARGET_TOKENS: u32 = 50_000;
Expand description

Token count the default sliding window compresses the history down to.

Half the trigger: enough to keep the last half hour or so of a call in full, so the model still has the conversation it is in.