Module file_format 

ParquetFormat: Parquet FileFormat abstractions

Structs

ObjectStoreFetch

[MetadataFetch] adapter for reading bytes from an [ObjectStore]

ParquetFormat

The Apache Parquet FileFormat implementation

ParquetFormatFactory

Factory struct used to create ParquetFormat

ParquetSink

Implements DataSink for writing to a parquet file.

Functions

apply_file_schema_type_coercions

Apply necessary schema type coercions to make file schema match table schema.

coerce_file_schema_to_string_typeDeprecated

If the table schema uses a string type, coerce the file schema to use a string type.

coerce_file_schema_to_view_typeDeprecated

Coerces the file schema if the table schema uses a view type.

coerce_int96_to_resolution

Coerces the file schema’s Timestamps to the provided TimeUnit if Parquet schema contains INT96.

fetch_parquet_metadataDeprecated

Fetches parquet metadata from ObjectStore for given object

fetch_statisticsDeprecated

Read and parse the statistics of the Parquet file at location path

statistics_from_parquet_meta_calcDeprecated

transform_binary_to_string

Transform a schema so that any binary types are strings

transform_schema_to_view

Transform a schema to use view types for Utf8 and Binary