Expand description
Sort that deals with an arbitrary size of the input. It will do in-memory sorting if it has enough memory budget but spills to disk if needed.
Structsยง
- External
Sorter ๐ - Sorts an arbitrary sized, unsorted, stream of [
RecordBatch]es to a total order. Depending on the input size and memory manager configuration, writes intermediate results to disk (โspillsโ) using Arrow IPC format. - External
Sorter ๐Metrics - Sort
Exec - Sort execution plan.
Functionsยง
- get_
reserved_ ๐byte_ for_ record_ batch - Estimate how much memory is needed to sort a
RecordBatch. - get_
reserved_ ๐byte_ for_ record_ batch_ size - Estimate how much memory is needed to sort a
RecordBatch. - sort_
batch