com.cloudera.impala.catalog.HdfsCompression Enum Reference

Collaboration diagram for com.cloudera.impala.catalog.HdfsCompression:

Public Member Functions
THdfsCompression	toThrift ()

Static Public Member Functions
static HdfsCompression	fromFileName (String fileName)
static HdfsCompression	fromHdfsInputFormatClass (String inputFormatClass)

Public Attributes
	NONE
	DEFLATE
	GZIP
	BZIP2
	SNAPPY
	LZO

Static Private Attributes
staticfinal ImmutableMap < String, HdfsCompression >	SUFFIX_MAP

Detailed Description

Support for recognizing compression suffixes on data files. Compression of a file is recognized in mapreduce by looking for suffixes of supported codecs. For now Impala supports LZO, GZIP, SNAPPY, and BZIP2. LZO can use the specific HIVE input class.

Definition at line 16 of file HdfsCompression.java.

Member Function Documentation

static HdfsCompression com.cloudera.impala.catalog.HdfsCompression.fromFileName ( String  fileName )

inlinestatic

Definition at line 37 of file HdfsCompression.java.

Referenced by com.cloudera.impala.catalog.HdfsTable.createPartition(), and com.cloudera.impala.catalog.HdfsTable.synthesizeBlockMetadata().

static HdfsCompression com.cloudera.impala.catalog.HdfsCompression.fromHdfsInputFormatClass ( String  inputFormatClass )

inlinestatic

Definition at line 61 of file HdfsCompression.java.

References com.cloudera.impala.catalog.HdfsFileFormat.LZO_TEXT_INPUT_FORMAT.

THdfsCompression com.cloudera.impala.catalog.HdfsCompression.toThrift ( )

inline

Definition at line 48 of file HdfsCompression.java.

Member Data Documentation

com.cloudera.impala.catalog.HdfsCompression.BZIP2

Definition at line 20 of file HdfsCompression.java.

com.cloudera.impala.catalog.HdfsCompression.DEFLATE

Definition at line 18 of file HdfsCompression.java.

com.cloudera.impala.catalog.HdfsCompression.GZIP

Definition at line 19 of file HdfsCompression.java.

com.cloudera.impala.catalog.HdfsCompression.LZO

Definition at line 22 of file HdfsCompression.java.

Referenced by com.cloudera.impala.analysis.ToSqlUtils.getCreateTableSql(), and com.cloudera.impala.catalog.HdfsFileFormat.toSql().

com.cloudera.impala.catalog.HdfsCompression.NONE

Definition at line 17 of file HdfsCompression.java.

Referenced by com.cloudera.impala.analysis.ToSqlUtils.getCreateTableSql(), and com.cloudera.impala.catalog.HdfsFileFormat.isSplittable().

com.cloudera.impala.catalog.HdfsCompression.SNAPPY

Definition at line 21 of file HdfsCompression.java.

static final ImmutableMap<String, HdfsCompression> com.cloudera.impala.catalog.HdfsCompression.SUFFIX_MAP

staticprivate

Initial value:

=
      ImmutableMap.<String, HdfsCompression>builder().
          put("deflate", DEFLATE).
          put("gz", GZIP).
          put("bz2", BZIP2).
          put("snappy", SNAPPY).
          put("lzo", LZO).
          put("index", LZO_INDEX).
          build()

Definition at line 26 of file HdfsCompression.java.

---

The documentation for this enum was generated from the following file:

• fe/src/main/java/com/cloudera/impala/catalog/HdfsCompression.java