async fn hive_style_partitions_demuxer(
tx: UnboundedSender<(Path, Receiver<RecordBatch>)>,
input: SendableRecordBatchStream,
context: Arc<TaskContext>,
partition_by: Vec<(String, DataType)>,
base_output_path: ListingTableUrl,
file_extension: String,
keep_partition_by_columns: bool,
) -> Result<()>Expand description
Splits an input stream based on the distinct values of a set of columns Assumes standard hive style partition paths such as /col1=val1/col2=val2/outputfile.parquet