Module parquet_writer

Module parquet_writer 

Source
Expand description

Options related to how parquet files should be written

StructsΒ§

ParquetWriterOptions
Options for writing parquet files

FunctionsΒ§

check_level_is_none πŸ”’
Helper to ensure compression codecs which don’t support levels don’t have one set. E.g. snappy(2) is invalid.
parse_compression_string
Parses datafusion.execution.parquet.compression String to a parquet::basic::Compression
parse_encoding_string πŸ”’
Parses datafusion.execution.parquet.encoding String to a parquet::basic::Encoding
parse_statistics_string πŸ”’
parse_version_string πŸ”’
require_level πŸ”’
Helper to ensure compression codecs which require a level do have one set. E.g. zstd is invalid, zstd(3) is valid
split_compression_string πŸ”’
Splits compression string into compression codec and optional compression_level I.e. gzip(2) -> gzip, 2