Struct CachedParquetFileReaderFactory 

pub struct CachedParquetFileReaderFactory {
    store: Arc<dyn ObjectStore>,
    metadata_cache: Arc<dyn FileMetadataCache>,
}

Implementation of ParquetFileReaderFactory supporting the caching of footer and page metadata. Reads and updates the [FileMetadataCache] with the [ParquetMetaData] data. This reader always loads the entire metadata (including page index, unless the file is encrypted), even if not required by the current query, to ensure it is always available for those that need it.

Fields

store: Arc<dyn ObjectStore>

metadata_cache: Arc<dyn FileMetadataCache>

Implementations

impl CachedParquetFileReaderFactory

pub fn new( store: Arc<dyn ObjectStore>, metadata_cache: Arc<dyn FileMetadataCache>, ) -> Self

Trait Implementations

impl Debug for CachedParquetFileReaderFactory

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl ParquetFileReaderFactory for CachedParquetFileReaderFactory

fn create_reader( &self, partition_index: usize, partitioned_file: PartitionedFile, metadata_size_hint: Option<usize>, metrics: &ExecutionPlanMetricsSet, ) -> Result<Box<dyn AsyncFileReader + Send>>

Provides an AsyncFileReader for reading data from a parquet file specified