Expand description
Re-exports the datafusion_datasource_parquet::file_format module, and contains tests for it.
Structs§
- Object
Store Fetch - [
MetadataFetch] adapter for reading bytes from an [ObjectStore] - Parquet
Format - The Apache Parquet
FileFormatimplementation - Parquet
Format Factory - Factory struct used to create ParquetFormat
- Parquet
Sink - Implements
DataSinkfor writing to a parquet file.
Functions§
- apply_
file_ schema_ type_ coercions - Apply necessary schema type coercions to make file schema match table schema.
- coerce_
file_ schema_ to_ string_ type Deprecated - If the table schema uses a string type, coerce the file schema to use a string type.
- coerce_
file_ schema_ to_ view_ type Deprecated - Coerces the file schema if the table schema uses a view type.
- coerce_
int96_ to_ resolution - Coerces the file schema’s Timestamps to the provided TimeUnit if Parquet schema contains INT96.
- fetch_
parquet_ metadata Deprecated - Fetches parquet metadata from ObjectStore for given object
- fetch_
statistics Deprecated - Read and parse the statistics of the Parquet file at location
path - statistics_
from_ parquet_ meta_ calc Deprecated - transform_
binary_ to_ string - Transform a schema so that any binary types are strings
- transform_
schema_ to_ view - Transform a schema to use view types for Utf8 and Binary