Data that is fixed across headers. This struct is shared between scan ranges. More...

Inheritance diagram for impala::HdfsSequenceScanner::SeqFileHeader:

Collaboration diagram for impala::HdfsSequenceScanner::SeqFileHeader:

Public Attributes
bool	is_row_compressed
	If true, the file uses row compression. More...

uint8_t	sync [SYNC_HASH_SIZE]
	The sync hash for this file. More...

bool	is_compressed
	true if the file is compressed More...

std::string	codec
	Codec name if it is compressed. More...

THdfsCompression::type	compression_type
	Enum for compression type. More...

int64_t	header_size

Detailed Description

Data that is fixed across headers. This struct is shared between scan ranges.

Definition at line 226 of file hdfs-sequence-scanner.h.

Member Data Documentation

std::string impala::BaseSequenceScanner::FileHeader::codec

inherited

Codec name if it is compressed.

Definition at line 63 of file base-sequence-scanner.h.

Referenced by impala::HdfsSequenceScanner::InitNewRange(), impala::HdfsRCFileScanner::InitNewRange(), impala::HdfsAvroScanner::ParseMetadata(), impala::HdfsSequenceScanner::ReadFileHeader(), and impala::HdfsRCFileScanner::ReadFileHeader().

THdfsCompression::type impala::BaseSequenceScanner::FileHeader::compression_type

inherited

Enum for compression type.

Definition at line 66 of file base-sequence-scanner.h.

Referenced by impala::BaseSequenceScanner::Close(), impala::HdfsAvroScanner::InitNewRange(), impala::HdfsAvroScanner::ParseMetadata(), impala::HdfsAvroScanner::ProcessRange(), impala::HdfsSequenceScanner::ReadFileHeader(), and impala::HdfsRCFileScanner::ReadFileHeader().

int64_t impala::BaseSequenceScanner::FileHeader::header_size

inherited

Byte size of header. This must not include the sync directly preceding the data (even if the sync is considered part of the header in the file format spec).

Definition at line 70 of file base-sequence-scanner.h.

Referenced by impala::BaseSequenceScanner::ProcessSplit(), impala::HdfsAvroScanner::ReadFileHeader(), impala::HdfsSequenceScanner::ReadFileHeader(), and impala::HdfsRCFileScanner::ReadFileHeader().