Struct RecordBatchStore 

struct RecordBatchStore {
    next_id: u32,
    batches: HashMap<u32, RecordBatchEntry>,
    batches_size: usize,
}

This structure tracks [RecordBatch] by an id so that:

1. The baches can be tracked via an id that can be copied cheaply
2. The total memory held by all batches is tracked

Fields

next_id: u32

id generator

batches: HashMap<u32, RecordBatchEntry>

storage

batches_size: usize

total size of all record batches tracked by this store

Implementations

impl RecordBatchStore

fn new() -> Self

pub fn register(&mut self, batch: RecordBatch) -> RecordBatchEntry

Register this batch with the store and assign an ID. No attempt is made to compare this batch to other batches

pub fn insert(&mut self, entry: RecordBatchEntry)

Insert a record batch entry into this store, tracking its memory use, if it has any uses

fn clear(&mut self)

Clear all values in this store, invalidating all previous batch ids

fn get(&self, id: u32) -> Option<&RecordBatchEntry>

fn len(&self) -> usize

returns the total number of batches stored in this store

fn unused_rows(&self) -> usize

Returns the total number of rows in batches minus the number which are in use

fn is_empty(&self) -> bool

returns true if the store has nothing stored

pub fn unuse(&mut self, id: u32)

remove a use from the specified batch id. If the use count reaches zero the batch entry is removed from the store

panics if there were no remaining uses of id

pub fn size(&self) -> usize

returns the size of memory used by this store, including all referenced RecordBatches, in bytes

Trait Implementations

impl Debug for RecordBatchStore

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.