Struct CacheManager 

pub struct CacheManager {
    file_statistic_cache: Option<Arc<dyn CacheAccessor<Path, Arc<Statistics>, Extra = ObjectMeta>>>,
    list_files_cache: Option<Arc<dyn CacheAccessor<Path, Arc<Vec<ObjectMeta>>, Extra = ObjectMeta>>>,
    file_metadata_cache: Arc<dyn FileMetadataCache<Extra = ObjectMeta>>,
}

Manages various caches used in DataFusion.

Following DataFusion design principles, DataFusion provides default cache implementations, while also allowing users to provide their own custom cache implementations by implementing the relevant traits.

See CacheManagerConfig for configuration options.

Fields

file_statistic_cache: Option<Arc<dyn CacheAccessor<Path, Arc<Statistics>, Extra = ObjectMeta>>>

list_files_cache: Option<Arc<dyn CacheAccessor<Path, Arc<Vec<ObjectMeta>>, Extra = ObjectMeta>>>

file_metadata_cache: Arc<dyn FileMetadataCache<Extra = ObjectMeta>>

Implementations

impl CacheManager

pub fn try_new( config: &CacheManagerConfig, ) -> Result<Arc<CacheManager>, DataFusionError>

pub fn get_file_statistic_cache( &self, ) -> Option<Arc<dyn CacheAccessor<Path, Arc<Statistics>, Extra = ObjectMeta>>>

Get the cache of listing files statistics.

pub fn get_list_files_cache( &self, ) -> Option<Arc<dyn CacheAccessor<Path, Arc<Vec<ObjectMeta>>, Extra = ObjectMeta>>>

Get the cache for storing the result of listing [ObjectMeta]s under the same path.

pub fn get_file_metadata_cache( &self, ) -> Arc<dyn FileMetadataCache<Extra = ObjectMeta>>

Get the file embedded metadata cache.

pub fn get_metadata_cache_limit(&self) -> usize

Get the limit of the file embedded metadata cache.

Trait Implementations

impl Debug for CacheManager

fn fmt(&self, f: &mut Formatter<'_>) -> Result<(), Error>

Formats the value using the given formatter.