Expand description
This file implements the RepartitionExec operator, which maps N input
partitions to M output partitions based on a partitioning scheme, optionally
maintaining the order of the input rows in the output.
Modules§
- distributor_
channels 🔒 - Special channel construction to distribute data from various inputs into N outputs minimizing buffering but preventing deadlocks when repartitioning
Structs§
- Batch
Partitioner - A utility that can be used to partition batches based on
Partitioning - Consuming
Input 🔒Streams State - Partition
Channels 🔒 - Channels and resources for a single output partition
- PerPartition
Stream 🔒 - This struct converts a receiver to a stream. Receiver receives data on an SPSC channel.
- Repartition
Exec - Maps
Ninput partitions toMoutput partitions based on aPartitioningscheme. - Repartition
Metrics 🔒 - Repartition
Stream 🔒
Enums§
- Batch
Partitioner 🔒State - Repartition
Batch 🔒 - A batch in the repartition queue - either in memory or spilled to disk
- Repartition
Exec 🔒State - Inner state of
RepartitionExec. - Repartition
Stream 🔒State