Module sort

Module sort 

Source
Expand description

Sort that deals with an arbitrary size of the input. It will do in-memory sorting if it has enough memory budget but spills to disk if needed.

Structsยง

ExternalSorter ๐Ÿ”’
Sorts an arbitrary sized, unsorted, stream of [RecordBatch]es to a total order. Depending on the input size and memory manager configuration, writes intermediate results to disk (โ€œspillsโ€) using Arrow IPC format.
ExternalSorterMetrics ๐Ÿ”’
SortExec
Sort execution plan.

Functionsยง

get_reserved_byte_for_record_batch ๐Ÿ”’
Estimate how much memory is needed to sort a RecordBatch.
get_reserved_byte_for_record_batch_size ๐Ÿ”’
Estimate how much memory is needed to sort a RecordBatch.
sort_batch