Struct DiskManager 

pub struct DiskManager {
    local_dirs: Mutex<Option<Vec<Arc<TempDir>>>>,
    max_temp_directory_size: u64,
    used_disk_space: Arc<AtomicU64>,
}

Manages files generated during query execution, e.g. spill files generated while processing dataset larger than available memory.

Fields

local_dirs: Mutex<Option<Vec<Arc<TempDir>>>>

TempDirs to put temporary files in.

If Some(vec![]) a new OS specified temporary directory will be created If None an error will be returned (configured not to spill)

max_temp_directory_size: u64

The maximum amount of data (in bytes) stored inside the temporary directories. Default to 100GB

used_disk_space: Arc<AtomicU64>

Used disk space in the temporary directories. Now only spilled data for external executors are counted.

Implementations

impl DiskManager

pub fn builder() -> DiskManagerBuilder

Creates a builder for DiskManager

pub fn try_new(config: DiskManagerConfig) -> Result<Arc<Self>>

👎Deprecated since 48.0.0: Use DiskManager::builder() instead

Create a DiskManager given the configuration

pub fn set_max_temp_directory_size( &mut self, max_temp_directory_size: u64, ) -> Result<()>

pub fn set_arc_max_temp_directory_size( this: &mut Arc<Self>, max_temp_directory_size: u64, ) -> Result<()>

pub fn with_max_temp_directory_size( self, max_temp_directory_size: u64, ) -> Result<Self>

pub fn used_disk_space(&self) -> u64

pub fn tmp_files_enabled(&self) -> bool

Return true if this disk manager supports creating temporary files. If this returns false, any call to create_tmp_file will error.

pub fn create_tmp_file( self: &Arc<Self>, request_description: &str, ) -> Result<RefCountedTempFile>

Return a temporary file from a randomized choice in the configured locations

If the file can not be created for some reason, returns an error message referencing the request description

Trait Implementations

impl Debug for DiskManager

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.