com.cloudera.impala.planner.HdfsTableSink Class Reference

Inheritance diagram for com.cloudera.impala.planner.HdfsTableSink:

Collaboration diagram for com.cloudera.impala.planner.HdfsTableSink:

Public Member Functions
	HdfsTableSink (Table targetTable, List< Expr > partitionKeyExprs, boolean overwrite)
void	computeCosts ()
String	getExplainString (String prefix, String detailPrefix, TExplainLevel explainLevel)
void	setFragment (PlanFragment fragment)
PlanFragment	getFragment ()
long	getPerHostMemCost ()

Static Public Member Functions
static DataSink	createDataSink (Table table, List< Expr > partitionKeyExprs, boolean overwrite)

Protected Member Functions
TDataSink	toThrift ()

Protected Attributes
final long	DEFAULT_NUM_PARTITIONS = 10
final List< Expr >	partitionKeyExprs_
final boolean	overwrite_
final Table	targetTable_
long	perHostMemCost_ = -1
PlanFragment	fragment_

Private Member Functions
long	getPerPartitionMemReq (HdfsFileFormat format)

Detailed Description

Base class for Hdfs data sinks such as HdfsTextTableSink.

Definition at line 36 of file HdfsTableSink.java.

Constructor & Destructor Documentation

com.cloudera.impala.planner.HdfsTableSink.HdfsTableSink ( Table  targetTable, List< Expr >  partitionKeyExprs, boolean  overwrite  )

inline

Definition at line 45 of file HdfsTableSink.java.

References com.cloudera.impala.planner.HdfsTableSink.overwrite_, and com.cloudera.impala.planner.HdfsTableSink.partitionKeyExprs_.

Member Function Documentation

void com.cloudera.impala.planner.HdfsTableSink.computeCosts ( )

inline

Definition at line 54 of file HdfsTableSink.java.

References com.cloudera.impala.planner.HdfsTableSink.DEFAULT_NUM_PARTITIONS, com.cloudera.impala.planner.HdfsTableSink.getPerPartitionMemReq(), com.cloudera.impala.planner.HdfsTableSink.partitionKeyExprs_, com.cloudera.impala.planner.DataSink.perHostMemCost_, and com.cloudera.impala.planner.TableSink.targetTable_.

static DataSink com.cloudera.impala.planner.DataSink.createDataSink ( Table  table, List< Expr >  partitionKeyExprs, boolean  overwrite  )

inlinestaticinherited

Returns an output sink appropriate for writing to the given table.

Definition at line 59 of file DataSink.java.

String com.cloudera.impala.planner.HdfsTableSink.getExplainString ( String  prefix, String  detailPrefix, TExplainLevel  explainLevel  )

inline

Definition at line 99 of file HdfsTableSink.java.

References com.cloudera.impala.planner.HdfsTableSink.overwrite_, com.cloudera.impala.planner.HdfsTableSink.partitionKeyExprs_, and com.cloudera.impala.planner.DataSink.perHostMemCost_.

PlanFragment com.cloudera.impala.planner.DataSink.getFragment ( )

inlineinherited

Definition at line 53 of file DataSink.java.

References com.cloudera.impala.planner.DataSink.fragment_.

long com.cloudera.impala.planner.DataSink.getPerHostMemCost ( )

inlineinherited

Definition at line 54 of file DataSink.java.

References com.cloudera.impala.planner.DataSink.perHostMemCost_.

Referenced by com.cloudera.impala.planner.PipelinedPlanNodeSet.computeResourceEstimates().

long com.cloudera.impala.planner.HdfsTableSink.getPerPartitionMemReq ( HdfsFileFormat  format )

inlineprivate

Returns the per-partition memory requirement for inserting into the given file format.

Definition at line 85 of file HdfsTableSink.java.

Referenced by com.cloudera.impala.planner.HdfsTableSink.computeCosts().

void com.cloudera.impala.planner.DataSink.setFragment ( PlanFragment  fragment )

inlineinherited

Definition at line 52 of file DataSink.java.

References com.cloudera.impala.planner.DataSink.fragment_.

TDataSink com.cloudera.impala.planner.HdfsTableSink.toThrift ( )

inlineprotected

Definition at line 136 of file HdfsTableSink.java.

References com.cloudera.impala.catalog.Table.getId(), com.cloudera.impala.planner.HdfsTableSink.overwrite_, com.cloudera.impala.planner.HdfsTableSink.partitionKeyExprs_, com.cloudera.impala.planner.TableSink.targetTable_, and com.cloudera.impala.analysis.Expr.treesToThrift().

Member Data Documentation

final long com.cloudera.impala.planner.HdfsTableSink.DEFAULT_NUM_PARTITIONS = 10

protected

Definition at line 38 of file HdfsTableSink.java.

Referenced by com.cloudera.impala.planner.HdfsTableSink.computeCosts().

PlanFragment com.cloudera.impala.planner.DataSink.fragment_

protectedinherited

Definition at line 41 of file DataSink.java.

Referenced by com.cloudera.impala.planner.DataSink.getFragment(), and com.cloudera.impala.planner.DataSink.setFragment().

final boolean com.cloudera.impala.planner.HdfsTableSink.overwrite_

protected

Definition at line 43 of file HdfsTableSink.java.

Referenced by com.cloudera.impala.planner.HdfsTableSink.getExplainString(), com.cloudera.impala.planner.HdfsTableSink.HdfsTableSink(), and com.cloudera.impala.planner.HdfsTableSink.toThrift().

final List<Expr> com.cloudera.impala.planner.HdfsTableSink.partitionKeyExprs_

protected

Definition at line 41 of file HdfsTableSink.java.

Referenced by com.cloudera.impala.planner.HdfsTableSink.computeCosts(), com.cloudera.impala.planner.HdfsTableSink.getExplainString(), com.cloudera.impala.planner.HdfsTableSink.HdfsTableSink(), and com.cloudera.impala.planner.HdfsTableSink.toThrift().

long com.cloudera.impala.planner.DataSink.perHostMemCost_ = -1

protectedinherited

Definition at line 38 of file DataSink.java.

Referenced by com.cloudera.impala.planner.HdfsTableSink.computeCosts(), com.cloudera.impala.planner.DataSink.computeCosts(), com.cloudera.impala.planner.HBaseTableSink.getExplainString(), com.cloudera.impala.planner.HdfsTableSink.getExplainString(), and com.cloudera.impala.planner.DataSink.getPerHostMemCost().

final Table com.cloudera.impala.planner.TableSink.targetTable_

protectedinherited

Definition at line 25 of file TableSink.java.

Referenced by com.cloudera.impala.planner.HdfsTableSink.computeCosts(), com.cloudera.impala.planner.TableSink.TableSink(), com.cloudera.impala.planner.HBaseTableSink.toThrift(), and com.cloudera.impala.planner.HdfsTableSink.toThrift().

---

The documentation for this class was generated from the following file:

• fe/src/main/java/com/cloudera/impala/planner/HdfsTableSink.java