Struct TestParquetFile 

pub struct TestParquetFile {
    path: PathBuf,
    schema: SchemaRef,
    object_store_url: ObjectStoreUrl,
    object_meta: ObjectMeta,
}

a ParquetFile that has been created for testing.

Fields

path: PathBuf

schema: SchemaRef

object_store_url: ObjectStoreUrl

object_meta: ObjectMeta

Implementations

impl TestParquetFile

pub fn try_new( path: PathBuf, props: WriterProperties, batches: impl IntoIterator<Item = RecordBatch>, ) -> Result<Self>

Creates a new parquet file at the specified location with the given properties

impl TestParquetFile

pub async fn create_scan( &self, ctx: &SessionContext, maybe_filter: Option<Expr>, ) -> Result<Arc<dyn ExecutionPlan>>

Return a DataSourceExec with the specified options.

If maybe_filter is non-None, the DataSourceExec will be filtered using the given expression, and this method will return the same plan that DataFusion will make with a pushed down predicate followed by a filter:

(FilterExec)
  (DataSourceExec)

Otherwise if maybe_filter is None, return just a DataSourceExec

pub fn parquet_metrics(plan: &Arc<dyn ExecutionPlan>) -> Option<MetricsSet>

Retrieve metrics from the parquet exec returned from create_scan

Recursively searches for DataSourceExec and returns the metrics on the first one it finds

pub fn schema(&self) -> SchemaRef

The schema of this parquet file

pub fn path(&self) -> &Path

The path to the parquet file