Inheritance diagram for com.cloudera.impala.catalog.Table:

Collaboration diagram for com.cloudera.impala.catalog.Table:

Public Member Functions
abstract int	getNumNodes ()

abstract TTableDescriptor	toThriftDescriptor (Set< Long > referencedPartitions)

abstract TCatalogObjectType	getCatalogObjectType ()

abstract void	load (Table oldValue, HiveMetaStoreClient client, org.apache.hadoop.hive.metastore.api.Table msTbl) throws TableLoadingException

void	addColumn (Column col)

void	clearColumns ()

void	updateLastDdlTime (long ddlTime)

void	validate () throws TableLoadingException

TTable	toThrift ()

TCatalogObject	toTCatalogObject ()

Db	getDb ()

String	getName ()

String	getFullName ()

TableName	getTableName ()

String	getOwner ()

ArrayList< Column >	getColumns ()

List< String >	getColumnNames ()

String	getStorageHandlerClassName ()

ArrayList< Column >	getColumnsInHiveOrder ()

List< Column >	getNonClusteringColumns ()

Column	getColumn (String name)

org.apache.hadoop.hive.metastore.api.Table	getMetaStoreTable ()

int	getNumClusteringCols ()

TableId	getId ()

long	getNumRows ()

ArrayType	getType ()

long	getCatalogVersion ()

void	setCatalogVersion (long catalogVersion)

boolean	isLoaded ()

Static Public Member Functions
static Table	fromMetastoreTable (TableId id, Db db, org.apache.hadoop.hive.metastore.api.Table msTbl)

static Table	fromThrift (Db parentDb, TTable thriftTable) throws TableLoadingException

Protected Member Functions
	Table (TableId id, org.apache.hadoop.hive.metastore.api.Table msTable, Db db, String name, String owner)

List< String >	getColumnNamesWithHmsStats ()

void	loadAllColumnStats (HiveMetaStoreClient client)

void	loadFromThrift (TTable thriftTable) throws TableLoadingException

Type	parseColumnType (FieldSchema fs) throws TableLoadingException

Static Protected Member Functions
static long	getRowCount (Map< String, String > parameters)

Protected Attributes
final org.apache.hadoop.hive.metastore.api.Table	msTable_

final TableId	id_

final Db	db_

final String	name_

final String	owner_

TTableDescriptor	tableDesc_

List< FieldSchema >	fields_

TAccessLevel	accessLevel_ = TAccessLevel.READ_WRITE

int	numClusteringCols_

long	numRows_ = -1

final ArrayType	type_ = new ArrayType(new StructType())

long	lastDdlTime_

Static Protected Attributes
static EnumSet< TableType >	SUPPORTED_TABLE_TYPES

Private Attributes
long	catalogVersion_ = Catalog.INITIAL_CATALOG_VERSION

final ArrayList< Column >	colsByPos_ = Lists.newArrayList()

final Map< String, Column >	colsByName_ = Maps.newHashMap()

Static Private Attributes
static final Logger	LOG = Logger.getLogger(Table.class)

static final Object	metastoreAccessLock_ = new Object()

Detailed Description

Base class for table metadata.

This includes the concept of clustering columns, which are columns by which the table data is physically clustered. In other words, if two rows share the same values for the clustering columns, those two rows are most likely colocated. Note that this is more general than Hive's CLUSTER BY ... INTO BUCKETS clause (which partitions a key range into a fixed number of buckets).

Definition at line 51 of file Table.java.

Constructor & Destructor Documentation

com.cloudera.impala.catalog.Table.Table	(	TableId	id,
		org.apache.hadoop.hive.metastore.api.Table	msTable,
		Db	db,
		String	name,
		String	owner
	)

inlineprotected

Definition at line 91 of file Table.java.

References com.cloudera.impala.catalog.Table.db_, com.cloudera.impala.catalog.CatalogServiceCatalog.getLastDdlTime(), com.cloudera.impala.catalog.Table.id_, com.cloudera.impala.catalog.Table.lastDdlTime_, com.cloudera.impala.catalog.Table.msTable_, com.cloudera.impala.catalog.Table.name_, and com.cloudera.impala.catalog.Table.owner_.

Member Function Documentation

void com.cloudera.impala.catalog.Table.addColumn ( Column col )

inline

Definition at line 114 of file Table.java.

References com.cloudera.impala.catalog.ArrayType.getItemType(), and com.cloudera.impala.catalog.Table.type_.

Referenced by com.cloudera.impala.catalog.View.load(), com.cloudera.impala.catalog.HBaseTable.load(), com.cloudera.impala.catalog.DataSourceTable.loadColumns(), and com.cloudera.impala.catalog.HdfsTable.loadColumns().

void com.cloudera.impala.catalog.Table.clearColumns ( )

inline

Definition at line 121 of file Table.java.

References com.cloudera.impala.catalog.ArrayType.getItemType(), and com.cloudera.impala.catalog.Table.type_.

Referenced by com.cloudera.impala.catalog.HBaseTable.load().

static Table com.cloudera.impala.catalog.Table.fromMetastoreTable	(	TableId	id,
		Db	db,
		org.apache.hadoop.hive.metastore.api.Table	msTbl
	)

inlinestatic

Creates a table of the appropriate type based on the given hive.metastore.api.Table object.

Definition at line 207 of file Table.java.

References com.cloudera.impala.catalog.DataSourceTable.isDataSourceTable(), com.cloudera.impala.catalog.HBaseTable.isHBaseTable(), and com.cloudera.impala.catalog.HdfsFileFormat.isHdfsFormatClass().

static Table com.cloudera.impala.catalog.Table.fromThrift	(	Db	parentDb,
		TTable	thriftTable
	)		throws TableLoadingException

inlinestatic

Factory method that creates a new Table from its Thrift representation. Determines the type of table to create based on the Thrift table provided.

Definition at line 231 of file Table.java.

abstract TCatalogObjectType com.cloudera.impala.catalog.Table.getCatalogObjectType ( )

abstract

Implements com.cloudera.impala.catalog.CatalogObject.

Referenced by com.cloudera.impala.catalog.Table.toTCatalogObject().

long com.cloudera.impala.catalog.Table.getCatalogVersion ( )

inline

Implements com.cloudera.impala.catalog.CatalogObject.

Definition at line 408 of file Table.java.

References com.cloudera.impala.catalog.Table.catalogVersion_.

Referenced by com.cloudera.impala.catalog.CatalogServiceCatalog.dropPartition(), com.cloudera.impala.catalog.CatalogServiceCatalog.getCatalogObjects(), com.cloudera.impala.catalog.ImpaladCatalog.removeTable(), com.cloudera.impala.catalog.CatalogServiceCatalog.replaceTableIfUnchanged(), and com.cloudera.impala.catalog.Table.toTCatalogObject().

Column com.cloudera.impala.catalog.Table.getColumn ( String name )

inline

Case-insensitive lookup.

Definition at line 392 of file Table.java.

Referenced by com.cloudera.impala.catalog.Table.loadAllColumnStats(), and com.cloudera.impala.catalog.CatalogTest.testColStatsColTypeMismatch().

List<String> com.cloudera.impala.catalog.Table.getColumnNames ( )

inline

Returns a list of the column names ordered by position.

Definition at line 354 of file Table.java.

References com.cloudera.impala.catalog.Table.colsByPos_.

Referenced by com.cloudera.impala.analysis.ColumnLineageGraph.addTargetColumnLabels(), com.cloudera.impala.catalog.HdfsTable.getTHdfsTable(), com.cloudera.impala.catalog.DataSourceTable.toThriftDescriptor(), com.cloudera.impala.catalog.HBaseTable.toThriftDescriptor(), and com.cloudera.impala.catalog.HdfsTable.toThriftDescriptor().

List<String> com.cloudera.impala.catalog.Table.getColumnNamesWithHmsStats ( )

inlineprotected

Definition at line 144 of file Table.java.

References com.cloudera.impala.catalog.Table.colsByName_, and impala.name.

Referenced by com.cloudera.impala.catalog.Table.loadAllColumnStats().

ArrayList<Column> com.cloudera.impala.catalog.Table.getColumns ( )

inline

Definition at line 349 of file Table.java.

References com.cloudera.impala.catalog.Table.colsByPos_.

ArrayList<Column> com.cloudera.impala.catalog.Table.getColumnsInHiveOrder ( )

inline

Returns the list of all columns, but with partition columns at the end of the list rather than the beginning. This is equivalent to the order in which Hive enumerates columns.

Definition at line 373 of file Table.java.

References com.cloudera.impala.catalog.Table.colsByPos_, com.cloudera.impala.catalog.Table.getNonClusteringColumns(), and com.cloudera.impala.catalog.Table.numClusteringCols_.

Referenced by com.cloudera.impala.service.DescribeResultFactory.describeTableMinimal(), com.cloudera.impala.service.Frontend.getColumnStats(), and com.cloudera.impala.analysis.InsertStmt.prepareExpressions().

Db com.cloudera.impala.catalog.Table.getDb ( )

inline

Definition at line 341 of file Table.java.

References com.cloudera.impala.catalog.Table.db_.

Referenced by com.cloudera.impala.service.CatalogOpExecutor.alterTableUpdateStats(), com.cloudera.impala.service.CatalogOpExecutor.createHiveColStats(), com.cloudera.impala.analysis.Analyzer.getTable(), com.cloudera.impala.analysis.InsertStmt.setTargetTable(), com.cloudera.impala.analysis.ShowStatsStmt.toThrift(), com.cloudera.impala.analysis.ComputeStatsStmt.toThrift(), and com.cloudera.impala.service.CatalogOpExecutor.updateCatalog().

String com.cloudera.impala.catalog.Table.getFullName ( )

inline

Definition at line 343 of file Table.java.

References com.cloudera.impala.catalog.Table.db_, com.cloudera.impala.catalog.Db.getName(), and com.cloudera.impala.catalog.Table.name_.

TableId com.cloudera.impala.catalog.Table.getId ( )

inline

Definition at line 403 of file Table.java.

References com.cloudera.impala.catalog.Table.id_.

Referenced by com.cloudera.impala.planner.HBaseTableSink.toThrift(), and com.cloudera.impala.planner.HdfsTableSink.toThrift().

org.apache.hadoop.hive.metastore.api.Table com.cloudera.impala.catalog.Table.getMetaStoreTable ( )

inline

Returns the metastore.api.Table object this Table was created from. Returns null if the derived Table object was not created from a metastore Table (ex. InlineViews).

Definition at line 398 of file Table.java.

References com.cloudera.impala.catalog.Table.msTable_.

String com.cloudera.impala.catalog.Table.getName ( )

inline

Implements com.cloudera.impala.catalog.CatalogObject.

Definition at line 342 of file Table.java.

References com.cloudera.impala.catalog.Table.name_.

List<Column> com.cloudera.impala.catalog.Table.getNonClusteringColumns ( )

inline

Returns the list of all columns excluding any partition columns.

Definition at line 385 of file Table.java.

References com.cloudera.impala.catalog.Table.numClusteringCols_.

Referenced by com.cloudera.impala.analysis.ComputeStatsStmt.analyze(), and com.cloudera.impala.catalog.Table.getColumnsInHiveOrder().

int com.cloudera.impala.catalog.Table.getNumClusteringCols ( )

inline

Definition at line 402 of file Table.java.

References com.cloudera.impala.catalog.Table.numClusteringCols_.

Referenced by com.cloudera.impala.analysis.ShowPartitionsStmt.analyze(), com.cloudera.impala.analysis.ComputeStatsStmt.analyze(), com.cloudera.impala.catalog.CatalogTest.checkTableCols(), com.cloudera.impala.service.CatalogOpExecutor.dropTableOrView(), com.cloudera.impala.analysis.ComputeStatsStmt.getBaseColumnStatsQuerySelectList(), com.cloudera.impala.planner.HdfsScanNode.getNodeExplainString(), com.cloudera.impala.catalog.HdfsTable.getNonPartitionFieldSchemas(), com.cloudera.impala.planner.HdfsScanNode.prunePartitions(), and com.cloudera.impala.service.CatalogOpExecutor.updateCatalog().

abstract int com.cloudera.impala.catalog.Table.getNumNodes ( )

abstract

long com.cloudera.impala.catalog.Table.getNumRows ( )

inline

Definition at line 404 of file Table.java.

References com.cloudera.impala.catalog.Table.numRows_.

Referenced by com.cloudera.impala.analysis.IsNullPredicate.analyze().

String com.cloudera.impala.catalog.Table.getOwner ( )

inline

Definition at line 348 of file Table.java.

References com.cloudera.impala.catalog.Table.owner_.

static long com.cloudera.impala.catalog.Table.getRowCount ( Map< String, String > parameters )

inlinestaticprotected

Returns the value of the ROW_COUNT constant, or -1 if not found.

Definition at line 191 of file Table.java.

Referenced by com.cloudera.impala.catalog.DataSourceTable.load(), com.cloudera.impala.catalog.HBaseTable.load(), com.cloudera.impala.catalog.HdfsTable.load(), and com.cloudera.impala.catalog.HdfsTable.loadPartitions().

String com.cloudera.impala.catalog.Table.getStorageHandlerClassName ( )

inline

Subclasses should override this if they provide a storage handler class. Currently only HBase tables need to provide a storage handler.

Definition at line 366 of file Table.java.

TableName com.cloudera.impala.catalog.Table.getTableName ( )

inline

Definition at line 344 of file Table.java.

References com.cloudera.impala.catalog.Table.db_, com.cloudera.impala.catalog.Db.getName(), and com.cloudera.impala.catalog.Table.name_.

Referenced by com.cloudera.impala.analysis.ComputeStatsStmt.analyze(), com.cloudera.impala.service.CatalogOpExecutor.dropStats(), and com.cloudera.impala.analysis.InlineViewRef.InlineViewRef().

ArrayType com.cloudera.impala.catalog.Table.getType ( )

inline

Definition at line 405 of file Table.java.

References com.cloudera.impala.catalog.Table.type_.

Referenced by com.cloudera.impala.catalog.HdfsTable.load().

boolean com.cloudera.impala.catalog.Table.isLoaded ( )

inline

Implements com.cloudera.impala.catalog.CatalogObject.

Definition at line 416 of file Table.java.

Referenced by com.cloudera.impala.service.CatalogOpExecutor.getExistingTable(), com.cloudera.impala.service.Frontend.getMissingTbls(), com.cloudera.impala.catalog.CatalogServiceCatalog.getOrLoadTable(), com.cloudera.impala.testutil.ImpaladTestCatalog.getTable(), com.cloudera.impala.catalog.ImpaladCatalog.getTable(), and com.cloudera.impala.analysis.Analyzer.getTable().

abstract void com.cloudera.impala.catalog.Table.load	(	Table	oldValue,
		HiveMetaStoreClient	client,
		org.apache.hadoop.hive.metastore.api.Table	msTbl
	)		throws TableLoadingException

abstract

Populate members of 'this' from metastore info. Reuse metadata from oldValue if the metadata is still valid.

void com.cloudera.impala.catalog.Table.loadAllColumnStats ( HiveMetaStoreClient client )

inlineprotected

Loads column statistics for all columns in this table from the Hive metastore. Any errors are logged and ignored, since the absence of column stats is not critical to the correctness of the system.

Definition at line 155 of file Table.java.

References com.cloudera.impala.catalog.Table.getColumn(), com.cloudera.impala.catalog.Table.getColumnNamesWithHmsStats(), com.cloudera.impala.catalog.Table.getFullName(), com.cloudera.impala.catalog.Column.getType(), com.cloudera.impala.catalog.ColumnStats.isSupportedColType(), com.cloudera.impala.catalog.Table.name_, and com.cloudera.impala.catalog.Column.updateStats().

Referenced by com.cloudera.impala.catalog.HBaseTable.load(), and com.cloudera.impala.catalog.HdfsTable.loadColumns().

void com.cloudera.impala.catalog.Table.loadFromThrift ( TTable thriftTable ) throws TableLoadingException

inlineprotected

Definition at line 246 of file Table.java.

References com.cloudera.impala.catalog.Table.accessLevel_, com.cloudera.impala.catalog.Table.fields_, com.cloudera.impala.catalog.Column.getComment(), com.cloudera.impala.catalog.ArrayType.getItemType(), com.cloudera.impala.catalog.Column.getName(), com.cloudera.impala.catalog.Table.numClusteringCols_, com.cloudera.impala.catalog.Table.numRows_, and com.cloudera.impala.catalog.Table.type_.

Type com.cloudera.impala.catalog.Table.parseColumnType ( FieldSchema fs ) throws TableLoadingException

inlineprotected

Gets the ColumnType from the given FieldSchema by using Impala's SqlParser. Throws a TableLoadingException if the FieldSchema could not be parsed. The type can either be:

Supported by Impala, in which case the type is returned.
A type Impala understands but is not yet implemented (e.g. date), the type is returned but type.IsSupported() returns false.
A type Impala can't understand at all, and a TableLoadingException is thrown.

Definition at line 331 of file Table.java.

References com.cloudera.impala.catalog.Table.getName().

Referenced by com.cloudera.impala.catalog.View.load(), com.cloudera.impala.catalog.HBaseTable.load(), com.cloudera.impala.catalog.DataSourceTable.loadColumns(), com.cloudera.impala.catalog.HdfsTable.loadColumns(), and com.cloudera.impala.catalog.HBaseTable.supportsBinaryEncoding().

void com.cloudera.impala.catalog.Table.setCatalogVersion ( long catalogVersion )

inline

Implements com.cloudera.impala.catalog.CatalogObject.

Definition at line 411 of file Table.java.

References com.cloudera.impala.catalog.Table.catalogVersion_.

TCatalogObject com.cloudera.impala.catalog.Table.toTCatalogObject ( )

inline

Definition at line 314 of file Table.java.

References com.cloudera.impala.catalog.Table.getCatalogObjectType(), com.cloudera.impala.catalog.Table.getCatalogVersion(), and com.cloudera.impala.catalog.Table.toThrift().

TTable com.cloudera.impala.catalog.Table.toThrift ( )

inline

Definition at line 288 of file Table.java.

References com.cloudera.impala.catalog.Table.accessLevel_, com.cloudera.impala.catalog.Table.db_, com.cloudera.impala.catalog.Table.getMetaStoreTable(), com.cloudera.impala.catalog.Db.getName(), com.cloudera.impala.catalog.Table.name_, com.cloudera.impala.catalog.Table.numClusteringCols_, and com.cloudera.impala.catalog.Table.numRows_.

Referenced by com.cloudera.impala.catalog.Table.toTCatalogObject().

abstract TTableDescriptor com.cloudera.impala.catalog.Table.toThriftDescriptor ( Set< Long > referencedPartitions )

abstract

void com.cloudera.impala.catalog.Table.updateLastDdlTime ( long ddlTime )

inline

Updates the lastDdlTime for this Table, if the new value is greater than the existing value. Does nothing if the new value is less than or equal to the existing value.

Definition at line 132 of file Table.java.

References com.cloudera.impala.catalog.Table.lastDdlTime_.

void com.cloudera.impala.catalog.Table.validate ( ) throws TableLoadingException

inline

Checks preconditions for this table to function as expected. Currently only checks that all entries in colsByName_ use lower case keys.

Definition at line 279 of file Table.java.

References com.cloudera.impala.catalog.Table.colsByName_.

Member Data Documentation

TAccessLevel com.cloudera.impala.catalog.Table.accessLevel_ = TAccessLevel.READ_WRITE

protected

Definition at line 66 of file Table.java.

Referenced by com.cloudera.impala.catalog.HdfsTable.getFirstLocationWithoutWriteAccess(), com.cloudera.impala.catalog.HdfsTable.hasWriteAccess(), com.cloudera.impala.catalog.Table.loadFromThrift(), com.cloudera.impala.catalog.HdfsTable.loadPartitions(), and com.cloudera.impala.catalog.Table.toThrift().

long com.cloudera.impala.catalog.Table.catalogVersion_ = Catalog.INITIAL_CATALOG_VERSION

private

Definition at line 57 of file Table.java.

Referenced by com.cloudera.impala.catalog.Table.getCatalogVersion(), and com.cloudera.impala.catalog.Table.setCatalogVersion().

final Map<String, Column> com.cloudera.impala.catalog.Table.colsByName_ = Maps.newHashMap()

private

Definition at line 79 of file Table.java.

Referenced by com.cloudera.impala.catalog.Table.getColumnNamesWithHmsStats(), and com.cloudera.impala.catalog.Table.validate().

final ArrayList<Column> com.cloudera.impala.catalog.Table.colsByPos_ = Lists.newArrayList()

private

Definition at line 76 of file Table.java.

Referenced by com.cloudera.impala.catalog.Table.getColumnNames(), com.cloudera.impala.catalog.Table.getColumns(), and com.cloudera.impala.catalog.Table.getColumnsInHiveOrder().

final Db com.cloudera.impala.catalog.Table.db_

protected

Definition at line 61 of file Table.java.

List<FieldSchema> com.cloudera.impala.catalog.Table.fields_

protected

Definition at line 65 of file Table.java.

Referenced by com.cloudera.impala.catalog.HdfsTable.getFieldSchemas(), com.cloudera.impala.catalog.HdfsTable.loadColumns(), and com.cloudera.impala.catalog.Table.loadFromThrift().

final TableId com.cloudera.impala.catalog.Table.id_

protected

Definition at line 60 of file Table.java.

Referenced by com.cloudera.impala.catalog.Table.getId(), com.cloudera.impala.catalog.Table.Table(), com.cloudera.impala.catalog.DataSourceTable.toThriftDescriptor(), com.cloudera.impala.catalog.HBaseTable.toThriftDescriptor(), and com.cloudera.impala.catalog.HdfsTable.toThriftDescriptor().

long com.cloudera.impala.catalog.Table.lastDdlTime_

protected

Definition at line 85 of file Table.java.

Referenced by com.cloudera.impala.catalog.HdfsTable.load(), com.cloudera.impala.catalog.Table.Table(), and com.cloudera.impala.catalog.Table.updateLastDdlTime().

final Logger com.cloudera.impala.catalog.Table.LOG = Logger.getLogger(Table.class)

staticprivate

Definition at line 52 of file Table.java.

final Object com.cloudera.impala.catalog.Table.metastoreAccessLock_ = new Object()

staticprivate

Definition at line 56 of file Table.java.

final org.apache.hadoop.hive.metastore.api.Table com.cloudera.impala.catalog.Table.msTable_

protected

Definition at line 58 of file Table.java.

Referenced by com.cloudera.impala.catalog.Table.getMetaStoreTable(), and com.cloudera.impala.catalog.Table.Table().

final String com.cloudera.impala.catalog.Table.name_

protected

Definition at line 62 of file Table.java.

int com.cloudera.impala.catalog.Table.numClusteringCols_

protected

Definition at line 69 of file Table.java.

long com.cloudera.impala.catalog.Table.numRows_ = -1

protected

Definition at line 72 of file Table.java.

final String com.cloudera.impala.catalog.Table.owner_

protected

Definition at line 63 of file Table.java.

Referenced by com.cloudera.impala.catalog.Table.getOwner(), and com.cloudera.impala.catalog.Table.Table().

EnumSet<TableType> com.cloudera.impala.catalog.Table.SUPPORTED_TABLE_TYPES

staticprotected

Initial value:

= EnumSet.of(

TableType.EXTERNAL_TABLE, TableType.MANAGED_TABLE, TableType.VIRTUAL_VIEW)

Definition at line 88 of file Table.java.

TTableDescriptor com.cloudera.impala.catalog.Table.tableDesc_

protected

Definition at line 64 of file Table.java.

final ArrayType com.cloudera.impala.catalog.Table.type_ = new ArrayType(new StructType())

protected

Definition at line 82 of file Table.java.

Referenced by com.cloudera.impala.catalog.Table.addColumn(), com.cloudera.impala.catalog.Table.clearColumns(), com.cloudera.impala.catalog.Table.getType(), and com.cloudera.impala.catalog.Table.loadFromThrift().

The documentation for this class was generated from the following file:

fe/src/main/java/com/cloudera/impala/catalog/Table.java

Public Member Functions

Static Public Member Functions

Protected Member Functions

Static Protected Member Functions

Protected Attributes

Static Protected Attributes

Private Attributes

Static Private Attributes

Detailed Description

Constructor & Destructor Documentation

Member Function Documentation

Member Data Documentation