Struct SkipAggregationProbe 

struct SkipAggregationProbe {
    probe_rows_threshold: usize,
    probe_ratio_threshold: f64,
    input_rows: usize,
    num_groups: usize,
    should_skip: bool,
    is_locked: bool,
    skipped_aggregation_rows: Count,
}

Tracks if the aggregate should skip partial aggregations

See “partial aggregation” discussion on GroupedHashAggregateStream

Fields

probe_rows_threshold: usize

Aggregation ratio check performed when the number of input rows exceeds this threshold (from SessionConfig)

probe_ratio_threshold: f64

Maximum ratio of num_groups to input_rows for continuing aggregation (from SessionConfig). If the ratio exceeds this value, aggregation is skipped and input rows are directly converted to output

input_rows: usize

Number of processed input rows (updated during probing)

num_groups: usize

Number of total group values for input_rows (updated during probing)

should_skip: bool

Flag indicating further data aggregation may be skipped (decision made when probing complete)

is_locked: bool

Flag indicating further updates of SkipAggregationProbe state won’t make any effect (set either while probing or on probing completion)

skipped_aggregation_rows: Count

Number of rows where state was output without aggregation.

• If 0, all input rows were aggregated (should_skip was always false)

• if greater than zero, the number of rows which were output directly without aggregation

Implementations

impl SkipAggregationProbe

fn new( probe_rows_threshold: usize, probe_ratio_threshold: f64, skipped_aggregation_rows: Count, ) -> Self

fn update_state(&mut self, input_rows: usize, num_groups: usize)

Updates SkipAggregationProbe state:

• increments the number of input rows
• replaces the number of groups with the new value
• on probe_rows_threshold exceeded calculates aggregation ratio and sets should_skip flag
• if should_skip is set, locks further state updates

fn should_skip(&self) -> bool

fn record_skipped(&mut self, batch: &RecordBatch)

Record the number of rows that were output directly without aggregation