public class UnionOptimizer extends TezOpPlanVisitor
mCurrentWalker, mPlan
Constructor and Description |
---|
UnionOptimizer(TezOperPlan plan,
List<String> supportedStoreFuncs,
List<String> unsupportedStoreFuncs) |
Modifier and Type | Method and Description |
---|---|
void |
connectPredecessorsToVertexGroups(TezOperator unionOp,
TezOperator pred,
PhysicalPlan predClonedUnionPlan,
TezOperator[] storeVertexGroupOps,
TezOperator[] outputVertexGroupOps)
Connects the unionOp predecessor to the store vertex groups and the output vertex groups
and disconnects it from the unionOp.
|
static PhysicalPlan |
getUnionPredPlanFromSplit(PhysicalPlan plan,
String unionOpKey) |
static boolean |
isOptimizable(TezOperator tezOp) |
static boolean |
isOptimizableStoreFunc(TezOperator tezOp,
List<String> supportedStoreFuncs,
List<String> unsupportedStoreFuncs) |
void |
visitTezOp(TezOperator tezOp) |
getPlan, popWalker, pushWalker, visit
public UnionOptimizer(TezOperPlan plan, List<String> supportedStoreFuncs, List<String> unsupportedStoreFuncs)
public static boolean isOptimizable(TezOperator tezOp) throws VisitorException
VisitorException
public static boolean isOptimizableStoreFunc(TezOperator tezOp, List<String> supportedStoreFuncs, List<String> unsupportedStoreFuncs) throws VisitorException
VisitorException
public void visitTezOp(TezOperator tezOp) throws VisitorException
visitTezOp
in class TezOpPlanVisitor
VisitorException
public void connectPredecessorsToVertexGroups(TezOperator unionOp, TezOperator pred, PhysicalPlan predClonedUnionPlan, TezOperator[] storeVertexGroupOps, TezOperator[] outputVertexGroupOps) throws VisitorException, PlanException
pred
- Predecessor of union which will be made part of the vertex groupunionOp
- Union operatorpredClonedUnionPlan
- Cloned plan of the union merged to the predecessorstoreVertexGroupOps
- Store vertex groups to connect tooutputVertexGroupOps
- Tez LogicalOutput vertex groups to connect toVisitorException
PlanException
public static PhysicalPlan getUnionPredPlanFromSplit(PhysicalPlan plan, String unionOpKey) throws VisitorException
VisitorException
Copyright © 2007-2017 The Apache Software Foundation