Expand description
ParquetOpener for opening Parquet files
Structsยง
- Early
Stopping ๐Stream - Wraps an inner RecordBatchStream and a [
FilePruner] - Encryption
Context ๐ - Parquet
Opener ๐ - Implements
FileOpenerfor a parquet file
Functionsยง
- build_
page_ ๐pruning_ predicate - Build a page pruning predicate from an optional predicate expression. If the predicate is None or the predicate cannot be converted to a page pruning predicate, return None.
- build_
pruning_ ๐predicates - copy_
arrow_ ๐reader_ metrics - Copies metrics from ArrowReaderMetrics (the metrics collected by the arrow-rs parquet reader) to the parquet file metrics for DataFusion
- create_
initial_ ๐plan - Return the initial
ParquetAccessPlan - load_
page_ ๐index - Returns a
ArrowReaderMetadatawith the page index loaded, loading it from the underlyingAsyncFileReaderif necessary. - should_
enable_ ๐page_ index