impala::HdfsRCFileScanner::ColumnInfo Struct Reference

Collaboration diagram for impala::HdfsRCFileScanner::ColumnInfo:

Public Attributes
bool	materialize_column
	If true, this column should be materialized, otherwise, it can be skipped. More...
int32_t	buffer_len
	Uncompressed and compressed byte lengths for this column. More...
int32_t	uncompressed_buffer_len
int32_t	key_buffer_len
	Length and start of the key for this column. More...
uint8_t *	key_buffer
	This is a ptr into the scanner's key_buffer_ for this column. More...
int32_t	key_buffer_pos
	Current position in the key buffer. More...
int32_t	start_offset
	Offset into row_group_buffer_ for the start of this column. More...
int32_t	buffer_pos
	Offset from the start of the column for the next field in the column. More...
int32_t	current_field_len
	RLE: Length of the current field. More...
int32_t	current_field_len_rep
	RLE: Repetition count of the current field. More...

Detailed Description

Struct encapsulating all the state for parsing a single column from a row group

Definition at line 345 of file hdfs-rcfile-scanner.h.

Member Data Documentation

int32_t impala::HdfsRCFileScanner::ColumnInfo::buffer_len

Uncompressed and compressed byte lengths for this column.

Definition at line 350 of file hdfs-rcfile-scanner.h.

Referenced by impala::HdfsRCFileScanner::GetCurrentKeyBuffer(), and impala::HdfsRCFileScanner::ReadColumnBuffers().

int32_t impala::HdfsRCFileScanner::ColumnInfo::buffer_pos

Offset from the start of the column for the next field in the column.

Definition at line 365 of file hdfs-rcfile-scanner.h.

Referenced by impala::HdfsRCFileScanner::NextField(), and impala::HdfsRCFileScanner::ProcessRange().

int32_t impala::HdfsRCFileScanner::ColumnInfo::current_field_len

RLE: Length of the current field.

Definition at line 368 of file hdfs-rcfile-scanner.h.

Referenced by impala::HdfsRCFileScanner::NextField(), and impala::HdfsRCFileScanner::ProcessRange().

int32_t impala::HdfsRCFileScanner::ColumnInfo::current_field_len_rep

RLE: Repetition count of the current field.

Definition at line 370 of file hdfs-rcfile-scanner.h.

Referenced by impala::HdfsRCFileScanner::NextField().

uint8_t* impala::HdfsRCFileScanner::ColumnInfo::key_buffer

This is a ptr into the scanner's key_buffer_ for this column.

Definition at line 356 of file hdfs-rcfile-scanner.h.

Referenced by impala::HdfsRCFileScanner::GetCurrentKeyBuffer(), and impala::HdfsRCFileScanner::NextField().

int32_t impala::HdfsRCFileScanner::ColumnInfo::key_buffer_len

Length and start of the key for this column.

Definition at line 354 of file hdfs-rcfile-scanner.h.

int32_t impala::HdfsRCFileScanner::ColumnInfo::key_buffer_pos

Current position in the key buffer.

Definition at line 359 of file hdfs-rcfile-scanner.h.

Referenced by impala::HdfsRCFileScanner::NextField().

bool impala::HdfsRCFileScanner::ColumnInfo::materialize_column

If true, this column should be materialized, otherwise, it can be skipped.

Definition at line 347 of file hdfs-rcfile-scanner.h.

Referenced by impala::HdfsRCFileScanner::ProcessRange().

int32_t impala::HdfsRCFileScanner::ColumnInfo::start_offset

Offset into row_group_buffer_ for the start of this column.

Definition at line 362 of file hdfs-rcfile-scanner.h.

Referenced by impala::HdfsRCFileScanner::GetCurrentKeyBuffer(), impala::HdfsRCFileScanner::ProcessRange(), and impala::HdfsRCFileScanner::ReadColumnBuffers().

int32_t impala::HdfsRCFileScanner::ColumnInfo::uncompressed_buffer_len

Definition at line 351 of file hdfs-rcfile-scanner.h.

Referenced by impala::HdfsRCFileScanner::GetCurrentKeyBuffer(), and impala::HdfsRCFileScanner::ReadColumnBuffers().

---

The documentation for this struct was generated from the following file:

• be/src/exec/hdfs-rcfile-scanner.h