Interface ContextWindowCompressionConfig`Beta`

Enables context window compression to manage the model's context window.

This mechanism prevents the context from exceeding a given length.

interface ContextWindowCompressionConfig {
slidingWindow?: SlidingWindow;
triggerTokens?: number;
}

Properties

slidingWindow?: SlidingWindow

The sliding window compression mechanism.

triggerTokens?: number

The number of tokens (before running a turn) that triggers the context window compression.