Module helpers

Expand description

Helper functions for the table implementation

Structs§

describe_partition: Describe a partition as a (path, depth, files) tuple for easier assertions
evaluate_partition_prefix
expr_applicable_for_cols: Check whether the given expression can be resolved using only the columns col_names. This means that if this function returns true:
list_partitions: Returns a recursive list of the partitions in table_path up to max_depth
parse_partitions_for_path: Extract the partition values for the given file_path (in the given table_path) associated to the partitions defined by table_partition_cols
populate_partition_values 🔒
prune_partitions 🔒
pruned_partition_list: Discover the partitions on the given path and prune out files that belong to irrelevant partitions using filters expressions. filters should only contain expressions that can be evaluated using only the partition columns.
split_filesDeprecated: Partition the list of files into n groups