Impala
Impalaistheopensource,nativeanalyticdatabaseforApacheHadoop.
 All Classes Namespaces Files Functions Variables Typedefs Enumerations Enumerator Friends Macros
com.cloudera.impala.planner.ExchangeNode Class Reference
Inheritance diagram for com.cloudera.impala.planner.ExchangeNode:
Collaboration diagram for com.cloudera.impala.planner.ExchangeNode:

Public Member Functions

 ExchangeNode (PlanNodeId id)
 
void addChild (PlanNode node, boolean copyConjuncts)
 
void computeStats (Analyzer analyzer)
 
void setMergeInfo (SortInfo info, long offset)
 
PlanNodeId getId ()
 
void setId (PlanNodeId id)
 
long getLimit ()
 
boolean hasLimit ()
 
long getPerHostMemCost ()
 
long getCardinality ()
 
int getNumNodes ()
 
float getAvgRowSize ()
 
void setFragment (PlanFragment fragment)
 
PlanFragment getFragment ()
 
List< ExprgetConjuncts ()
 
ExprSubstitutionMap getOutputSmap ()
 
void setOutputSmap (ExprSubstitutionMap smap)
 
Set< ExprIdgetAssignedConjuncts ()
 
void setAssignedConjuncts (Set< ExprId > conjuncts)
 
void setLimit (long limit)
 
void unsetLimit ()
 
ArrayList< TupleIdgetTupleIds ()
 
ArrayList< TupleIdgetTblRefIds ()
 
void setTblRefIds (ArrayList< TupleId > ids)
 
Set< TupleIdgetNullableTupleIds ()
 
void addConjuncts (List< Expr > conjuncts)
 
void transferConjuncts (PlanNode recipient)
 
String getExplainString ()
 
TPlan treeToThrift ()
 
void init (Analyzer analyzer) throws InternalException
 
boolean isBlockingNode ()
 
void computeCosts (TQueryOptions queryOptions)
 
long getInputCardinality ()
 

Static Public Member Functions

static long addCardinalities (long a, long b)
 
static long multiplyCardinalities (long a, long b)
 

Protected Member Functions

String getNodeExplainString (String prefix, String detailPrefix, TExplainLevel detailLevel)
 
String getDisplayLabelDetail ()
 
void toThrift (TPlanNode msg)
 
final String getExplainString (String rootPrefix, String prefix, TExplainLevel detailLevel)
 
String getExplainString (List<?extends Expr > exprs)
 
void setDisplayName (String s)
 
final String getDisplayLabel ()
 
String getOffsetExplainString (String prefix)
 
void assignConjuncts (Analyzer analyzer)
 
ExprSubstitutionMap getCombinedChildSmap ()
 
void createDefaultSmap (Analyzer analyzer)
 
long capAtLimit (long cardinality)
 
void markSlotsMaterialized (Analyzer analyzer, List< Expr > exprs)
 
void computeMemLayout (Analyzer analyzer)
 
double computeSelectivity ()
 
String debugString ()
 
boolean hasValidStats ()
 

Protected Attributes

String displayName_
 
PlanNodeId id_
 
long limit_
 
ArrayList< TupleIdtupleIds_
 
ArrayList< TupleIdtblRefIds_
 
Set< TupleIdnullableTupleIds_ = Sets.newHashSet()
 
List< Exprconjuncts_ = Lists.newArrayList()
 
PlanFragment fragment_
 
ExprSubstitutionMap outputSmap_
 
Set< ExprIdassignedConjuncts_
 
long cardinality_
 
int numNodes_
 
float avgRowSize_
 
long perHostMemCost_ = -1
 

Static Protected Attributes

static final int DEFAULT_BATCH_SIZE = 1024
 

Private Attributes

SortInfo mergeInfo_
 
long offset_
 

Static Private Attributes

static final Logger LOG = LoggerFactory.getLogger(ExchangeNode.class)
 

Detailed Description

Receiver side of a 1:n data stream. Logically, an ExchangeNode consumes the data produced by its children. For each of the sending child nodes the actual data transmission is performed by the DataStreamSink of the PlanFragment housing that child node. Typically, an ExchangeNode only has a single sender child but, e.g., for distributed union queries an ExchangeNode may have one sender child per union operand.

If a (optional) SortInfo field is set, the ExchangeNode will merge its inputs on the parameters specified in the SortInfo object. It is assumed that the inputs are also sorted individually on the same SortInfo parameter.

Definition at line 45 of file ExchangeNode.java.

Constructor & Destructor Documentation

com.cloudera.impala.planner.ExchangeNode.ExchangeNode ( PlanNodeId  id)
inline

Member Function Documentation

static long com.cloudera.impala.planner.PlanNode.addCardinalities ( long  a,
long  b 
)
inlinestaticinherited
void com.cloudera.impala.planner.ExchangeNode.addChild ( PlanNode  node,
boolean  copyConjuncts 
)
inline
void com.cloudera.impala.planner.PlanNode.addConjuncts ( List< Expr conjuncts)
inlineinherited

Definition at line 209 of file PlanNode.java.

void com.cloudera.impala.planner.PlanNode.computeCosts ( TQueryOptions  queryOptions)
inlineinherited

Estimates the cost of executing this PlanNode. Currently only sets perHostMemCost_. May only be called after this PlanNode has been placed in a PlanFragment because the cost computation is dependent on the enclosing fragment's data partition.

Definition at line 562 of file PlanNode.java.

References com.cloudera.impala.planner.PlanNode.perHostMemCost_.

void com.cloudera.impala.planner.PlanNode.createDefaultSmap ( Analyzer  analyzer)
inlineprotectedinherited
String com.cloudera.impala.planner.PlanNode.debugString ( )
inlineprotectedinherited
Set<ExprId> com.cloudera.impala.planner.PlanNode.getAssignedConjuncts ( )
inlineinherited
ExprSubstitutionMap com.cloudera.impala.planner.PlanNode.getCombinedChildSmap ( )
inlineprotectedinherited
List<Expr> com.cloudera.impala.planner.PlanNode.getConjuncts ( )
inlineinherited
final String com.cloudera.impala.planner.PlanNode.getExplainString ( String  rootPrefix,
String  prefix,
TExplainLevel  detailLevel 
)
inlineprotectedinherited
String com.cloudera.impala.planner.PlanNode.getExplainString ( List<?extends Expr exprs)
inlineprotectedinherited

Definition at line 506 of file PlanNode.java.

PlanFragment com.cloudera.impala.planner.PlanNode.getFragment ( )
inlineinherited
long com.cloudera.impala.planner.PlanNode.getInputCardinality ( )
inlineinherited

The input cardinality is the sum of output cardinalities of its children. For scan nodes the input cardinality is the expected number of rows scanned.

Definition at line 570 of file PlanNode.java.

References com.cloudera.impala.planner.PlanNode.addCardinalities().

long com.cloudera.impala.planner.PlanNode.getLimit ( )
inlineinherited
String com.cloudera.impala.planner.ExchangeNode.getNodeExplainString ( String  prefix,
String  detailPrefix,
TExplainLevel  detailLevel 
)
inlineprotected
Set<TupleId> com.cloudera.impala.planner.PlanNode.getNullableTupleIds ( )
inlineinherited
String com.cloudera.impala.planner.PlanNode.getOffsetExplainString ( String  prefix)
inlineprotectedinherited

Return the offset_ details, if applicable. This is available separately from 'getNodeExplainString' because we want to output 'limit: ...' (which can be printed from PlanNode) before 'offset: ...', which is only printed from SortNodes right now.

Definition at line 336 of file PlanNode.java.

Referenced by com.cloudera.impala.planner.PlanNode.getExplainString().

ExprSubstitutionMap com.cloudera.impala.planner.PlanNode.getOutputSmap ( )
inlineinherited

Definition at line 178 of file PlanNode.java.

References com.cloudera.impala.planner.PlanNode.outputSmap_.

long com.cloudera.impala.planner.PlanNode.getPerHostMemCost ( )
inlineinherited
ArrayList<TupleId> com.cloudera.impala.planner.PlanNode.getTblRefIds ( )
inlineinherited
boolean com.cloudera.impala.planner.PlanNode.hasValidStats ( )
inlineprotectedinherited
void com.cloudera.impala.planner.PlanNode.init ( Analyzer  analyzer) throws InternalException
inlineinherited

Computes the full internal state, including smap and planner-relevant statistics (calls computeStats()), marks all slots referenced by this node as materialized and computes the mem layout of all materialized tuples (with the assumption that slots that are needed by ancestor PlanNodes have already been marked). Also performs final expr substitution with childrens' smaps and computes internal state required for toThrift(). This is called directly after construction.

Definition at line 392 of file PlanNode.java.

References com.cloudera.impala.planner.PlanNode.assignConjuncts(), com.cloudera.impala.planner.PlanNode.computeStats(), and com.cloudera.impala.planner.PlanNode.createDefaultSmap().

boolean com.cloudera.impala.planner.PlanNode.isBlockingNode ( )
inlineinherited

Returns true if this plan node can output its first row only after consuming all rows of all its children. This method is used to group plan nodes into pipelined units for resource estimation.

Definition at line 555 of file PlanNode.java.

Referenced by com.cloudera.impala.planner.PipelinedPlanNodeSet.computePlanNodeSets().

void com.cloudera.impala.planner.PlanNode.markSlotsMaterialized ( Analyzer  analyzer,
List< Expr exprs 
)
inlineprotectedinherited

Marks all slots referenced in exprs as materialized.

Definition at line 464 of file PlanNode.java.

Referenced by com.cloudera.impala.planner.HdfsScanNode.init().

static long com.cloudera.impala.planner.PlanNode.multiplyCardinalities ( long  a,
long  b 
)
inlinestaticinherited

Computes and returns the product of two cardinalities. If an overflow occurs, the maximum Long value is returned (Long.MAX_VALUE).

Definition at line 541 of file PlanNode.java.

Referenced by com.cloudera.impala.planner.CrossJoinNode.computeStats(), and com.cloudera.impala.planner.HashJoinNode.getJoinCardinality().

void com.cloudera.impala.planner.PlanNode.setAssignedConjuncts ( Set< ExprId conjuncts)
inlineinherited
void com.cloudera.impala.planner.PlanNode.setDisplayName ( String  s)
inlineprotectedinherited

Definition at line 223 of file PlanNode.java.

References com.cloudera.impala.planner.PlanNode.displayName_.

void com.cloudera.impala.planner.PlanNode.setFragment ( PlanFragment  fragment)
inlineinherited

Definition at line 175 of file PlanNode.java.

References com.cloudera.impala.planner.PlanNode.fragment_.

void com.cloudera.impala.planner.PlanNode.setId ( PlanNodeId  id)
inlineinherited

Definition at line 165 of file PlanNode.java.

References com.cloudera.impala.planner.PlanNode.id_.

void com.cloudera.impala.planner.PlanNode.setLimit ( long  limit)
inlineinherited

Set the limit_ to the given limit_ only if the limit_ hasn't been set, or the new limit_ is lower.

Parameters
limit_

Definition at line 190 of file PlanNode.java.

References com.cloudera.impala.planner.PlanNode.limit_.

void com.cloudera.impala.planner.ExchangeNode.setMergeInfo ( SortInfo  info,
long  offset 
)
inline

Set the parameters used to merge sorted input streams. This can be called after init().

Definition at line 117 of file ExchangeNode.java.

References com.cloudera.impala.planner.PlanNode.displayName_, com.cloudera.impala.planner.ExchangeNode.mergeInfo_, offset, and com.cloudera.impala.planner.ExchangeNode.offset_.

void com.cloudera.impala.planner.PlanNode.setOutputSmap ( ExprSubstitutionMap  smap)
inlineinherited

Definition at line 179 of file PlanNode.java.

References com.cloudera.impala.planner.PlanNode.outputSmap_.

void com.cloudera.impala.planner.PlanNode.setTblRefIds ( ArrayList< TupleId ids)
inlineinherited

Definition at line 202 of file PlanNode.java.

References com.cloudera.impala.planner.PlanNode.tblRefIds_.

void com.cloudera.impala.planner.PlanNode.transferConjuncts ( PlanNode  recipient)
inlineinherited

Definition at line 214 of file PlanNode.java.

References com.cloudera.impala.planner.PlanNode.conjuncts_.

TPlan com.cloudera.impala.planner.PlanNode.treeToThrift ( )
inlineinherited
void com.cloudera.impala.planner.PlanNode.unsetLimit ( )
inlineinherited

Definition at line 194 of file PlanNode.java.

References com.cloudera.impala.planner.PlanNode.limit_.

Member Data Documentation

final int com.cloudera.impala.planner.PlanNode.DEFAULT_BATCH_SIZE = 1024
staticprotectedinherited

Definition at line 63 of file PlanNode.java.

PlanNodeId com.cloudera.impala.planner.PlanNode.id_
protectedinherited
final Logger com.cloudera.impala.planner.ExchangeNode.LOG = LoggerFactory.getLogger(ExchangeNode.class)
staticprivate

Definition at line 46 of file ExchangeNode.java.

Set<TupleId> com.cloudera.impala.planner.PlanNode.nullableTupleIds_ = Sets.newHashSet()
protectedinherited
ArrayList<TupleId> com.cloudera.impala.planner.PlanNode.tblRefIds_
protectedinherited

The documentation for this class was generated from the following file: