impala::BaseSequenceScanner::FileHeader Struct Reference

#include <base-sequence-scanner.h>

Inheritance diagram for impala::BaseSequenceScanner::FileHeader:

Collaboration diagram for impala::BaseSequenceScanner::FileHeader:

Public Member Functions
virtual	~FileHeader ()

Public Attributes
uint8_t	sync [SYNC_HASH_SIZE]
	The sync hash for this file. More...
bool	is_compressed
	true if the file is compressed More...
std::string	codec
	Codec name if it is compressed. More...
THdfsCompression::type	compression_type
	Enum for compression type. More...
int64_t	header_size

Detailed Description

Data that is shared between scan ranges of the same file. The subclass is responsible for filling in all these fields in ReadFileHeader

Definition at line 53 of file base-sequence-scanner.h.

Constructor & Destructor Documentation

virtual impala::BaseSequenceScanner::FileHeader::~FileHeader ( )

inlinevirtual

Definition at line 54 of file base-sequence-scanner.h.

Member Data Documentation

std::string impala::BaseSequenceScanner::FileHeader::codec

Codec name if it is compressed.

Definition at line 63 of file base-sequence-scanner.h.

Referenced by impala::HdfsSequenceScanner::InitNewRange(), impala::HdfsRCFileScanner::InitNewRange(), impala::HdfsAvroScanner::ParseMetadata(), impala::HdfsSequenceScanner::ReadFileHeader(), and impala::HdfsRCFileScanner::ReadFileHeader().

THdfsCompression::type impala::BaseSequenceScanner::FileHeader::compression_type

Enum for compression type.

Definition at line 66 of file base-sequence-scanner.h.

Referenced by impala::BaseSequenceScanner::Close(), impala::HdfsAvroScanner::InitNewRange(), impala::HdfsAvroScanner::ParseMetadata(), impala::HdfsAvroScanner::ProcessRange(), impala::HdfsSequenceScanner::ReadFileHeader(), and impala::HdfsRCFileScanner::ReadFileHeader().

int64_t impala::BaseSequenceScanner::FileHeader::header_size

Byte size of header. This must not include the sync directly preceding the data (even if the sync is considered part of the header in the file format spec).

Definition at line 70 of file base-sequence-scanner.h.

Referenced by impala::BaseSequenceScanner::ProcessSplit(), impala::HdfsAvroScanner::ReadFileHeader(), impala::HdfsSequenceScanner::ReadFileHeader(), and impala::HdfsRCFileScanner::ReadFileHeader().

bool impala::BaseSequenceScanner::FileHeader::is_compressed

true if the file is compressed

Definition at line 60 of file base-sequence-scanner.h.

Referenced by impala::HdfsSequenceScanner::GetRecord(), impala::HdfsAvroScanner::InitNewRange(), impala::HdfsSequenceScanner::InitNewRange(), impala::HdfsRCFileScanner::InitNewRange(), impala::HdfsAvroScanner::ParseMetadata(), impala::HdfsSequenceScanner::ProcessBlockCompressedScanRange(), impala::HdfsAvroScanner::ProcessRange(), impala::HdfsSequenceScanner::ProcessRange(), impala::BaseSequenceScanner::ProcessSplit(), impala::HdfsRCFileScanner::ReadColumnBuffers(), impala::HdfsSequenceScanner::ReadFileHeader(), impala::HdfsRCFileScanner::ReadFileHeader(), and impala::HdfsRCFileScanner::ReadKeyBuffers().

uint8_t impala::BaseSequenceScanner::FileHeader::sync[SYNC_HASH_SIZE]

The sync hash for this file.

Definition at line 57 of file base-sequence-scanner.h.

Referenced by impala::BaseSequenceScanner::ProcessSplit(), impala::HdfsAvroScanner::ReadFileHeader(), impala::HdfsSequenceScanner::ReadFileHeader(), impala::HdfsRCFileScanner::ReadFileHeader(), and impala::BaseSequenceScanner::ReadSync().

---

The documentation for this struct was generated from the following file:

• be/src/exec/base-sequence-scanner.h