Modifier and Type | Class and Description |
---|---|
class |
PatternPlan
Used for finding/representing a pattern in the plan
This class represents the pattern
Finds only a single matching pattern
This is finding a sub-graph( represented by pattern) in the graph(plan)
|
Constructor and Description |
---|
PatternNode(OperatorPlan p) |
Modifier and Type | Class and Description |
---|---|
class |
BaseOperatorPlan |
class |
OperatorSubPlan
Class to represent a view of a plan.
|
Modifier and Type | Field and Description |
---|---|
protected OperatorPlan |
PlanWalker.plan |
protected OperatorPlan |
PlanVisitor.plan |
protected OperatorPlan |
Operator.plan |
Modifier and Type | Method and Description |
---|---|
OperatorPlan |
OperatorSubPlan.getBasePlan() |
OperatorPlan |
PlanWalker.getPlan() |
OperatorPlan |
PlanVisitor.getPlan() |
OperatorPlan |
Operator.getPlan()
Get the plan associated with this operator.
|
Modifier and Type | Method and Description |
---|---|
boolean |
OperatorSubPlan.isEqual(OperatorPlan other) |
boolean |
OperatorPlan.isEqual(OperatorPlan other)
This is like a shallow comparison.
|
boolean |
BaseOperatorPlan.isEqual(OperatorPlan other) |
protected static boolean |
BaseOperatorPlan.isEqual(OperatorPlan p1,
OperatorPlan p2) |
void |
PlanWalker.setPlan(OperatorPlan plan)
Set the plan for this walker to operate on.
|
void |
Operator.setPlan(OperatorPlan p) |
PlanWalker |
ReverseDependencyOrderWalkerWOSeenChk.spawnChildWalker(OperatorPlan plan) |
PlanWalker |
ReverseDependencyOrderWalker.spawnChildWalker(OperatorPlan plan) |
abstract PlanWalker |
PlanWalker.spawnChildWalker(OperatorPlan plan)
Return a new instance of this same type of walker for a subplan.
|
PlanWalker |
DepthFirstWalker.spawnChildWalker(OperatorPlan plan) |
PlanWalker |
DependencyOrderWalker.spawnChildWalker(OperatorPlan plan) |
Constructor and Description |
---|
DependencyOrderWalker(OperatorPlan plan) |
DepthFirstWalker(OperatorPlan plan) |
Operator(String n,
OperatorPlan p) |
OperatorSubPlan(OperatorPlan base) |
PlanVisitor(OperatorPlan plan,
PlanWalker walker) |
PlanWalker(OperatorPlan plan) |
ReverseDependencyOrderWalker(OperatorPlan plan) |
ReverseDependencyOrderWalkerWOSeenChk(OperatorPlan plan) |
SubtreeDependencyOrderWalker(OperatorPlan plan) |
SubtreeDependencyOrderWalker(OperatorPlan plan,
Operator startNode) |
Modifier and Type | Class and Description |
---|---|
class |
LogicalExpressionPlan
A plan containing LogicalExpressionOperators.
|
Modifier and Type | Method and Description |
---|---|
boolean |
LogicalExpressionPlan.isEqual(OperatorPlan other) |
Constructor and Description |
---|
AddExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
AllSameExpressionVisitor(OperatorPlan plan,
PlanWalker walker) |
AndExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
BinaryExpression(String name,
OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
BinCondExpression(OperatorPlan plan,
LogicalExpression condition,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators and the condition operator
|
CastExpression(OperatorPlan plan,
LogicalExpression exp,
LogicalSchema.LogicalFieldSchema fs) |
ColumnExpression(String name,
OperatorPlan plan) |
ConstantExpression(OperatorPlan plan,
Object val)
Adds expression to the plan
|
DereferenceExpression(OperatorPlan plan) |
DereferenceExpression(OperatorPlan plan,
int colNum) |
DereferenceExpression(OperatorPlan plan,
List<Integer> columnNums) |
DivideExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
EqualExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
ExpToPhyTranslationVisitor(OperatorPlan plan,
LogicalRelationalOperator op,
PhysicalPlan phyPlan,
Map<Operator,PhysicalOperator> map) |
ExpToPhyTranslationVisitor(OperatorPlan plan,
PlanWalker walker,
LogicalRelationalOperator op,
PhysicalPlan phyPlan,
Map<Operator,PhysicalOperator> map) |
GreaterThanEqualExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
GreaterThanExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
IsNullExpression(OperatorPlan plan,
LogicalExpression exp) |
LessThanEqualExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
LessThanExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
LogicalExpression(String name,
OperatorPlan plan) |
LogicalExpressionVisitor(OperatorPlan p,
PlanWalker walker) |
MapLookupExpression(OperatorPlan plan,
String mapKey) |
ModExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
MultiplyExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
NegativeExpression(OperatorPlan plan,
LogicalExpression exp) |
NotEqualExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
NotExpression(OperatorPlan plan,
LogicalExpression exp) |
OrExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
ProjectExpression(OperatorPlan plan,
int inputNum,
int colNum,
LogicalRelationalOperator attachedRelationalOp)
Adds projection to the plan.
|
ProjectExpression(OperatorPlan plan,
int inputNum,
LogicalRelationalOperator attachedRelationalOp)
Constructor for range projection
Adds projection to the plan.
|
ProjectExpression(OperatorPlan plan,
int inputNum,
String alias,
Operator projectedOp,
LogicalRelationalOperator attachedRelationalOp)
Adds projection to the plan.
|
ProjectExpression(ProjectExpression projExpr,
OperatorPlan plan)
like a copy constructor, but with a plan argument
|
RegexExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
ScalarExpression(OperatorPlan plan) |
ScalarExpression(OperatorPlan plan,
Operator implicitReferencedOperator,
Operator attachedLogicalOperator) |
SubtractExpression(OperatorPlan plan,
LogicalExpression lhs,
LogicalExpression rhs)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
UnaryExpression(String name,
OperatorPlan plan,
LogicalExpression exp)
Will add this operator to the plan and connect it to the
left and right hand side operators.
|
UserFuncExpression(OperatorPlan plan,
FuncSpec funcSpec) |
UserFuncExpression(OperatorPlan plan,
FuncSpec funcSpec,
boolean viaDefine) |
UserFuncExpression(OperatorPlan plan,
FuncSpec funcSpec,
List<LogicalExpression> args) |
UserFuncExpression(OperatorPlan plan,
FuncSpec funcSpec,
List<LogicalExpression> args,
boolean viaDefine) |
UserFuncExpression(OperatorPlan plan,
FuncSpec funcSpec,
List<LogicalExpression> args,
boolean viaDefine,
boolean lazilyInitializeInvokerFunction,
boolean invokerIsStatic,
String packageName,
String funcName) |
Modifier and Type | Method and Description |
---|---|
void |
SchemaPatcher.transformed(OperatorPlan fp,
OperatorPlan tp) |
void |
ProjectionPatcher.transformed(OperatorPlan fp,
OperatorPlan tp) |
Constructor and Description |
---|
AllExpressionVisitor(OperatorPlan plan,
PlanWalker walker) |
AllSameRalationalNodesVisitor(OperatorPlan plan,
PlanWalker walker) |
LogicalPlanOptimizer(OperatorPlan p,
int iterations,
Set<String> turnOffRules) |
LogicalPlanOptimizer(OperatorPlan p,
int iterations,
Set<String> turnOffRules,
PigContext pc)
Create a new LogicalPlanOptimizer.
|
LogicalPlanPrinter(OperatorPlan plan,
PrintStream ps) |
ProjectionFinder(OperatorPlan plan) |
SchemaResetter(OperatorPlan plan) |
SchemaResetter(OperatorPlan plan,
boolean skipDuplicateUidCheck) |
UidResetter(OperatorPlan plan) |
Modifier and Type | Class and Description |
---|---|
class |
LogicalPlan
LogicalPlan is the logical view of relational operations Pig will execute
for a given script.
|
Modifier and Type | Method and Description |
---|---|
boolean |
LogicalPlan.isEqual(OperatorPlan other)
Equality is checked by calling equals on every leaf in the plan.
|
boolean |
MapSideMergeValidator.validateMapSideMerge(List<Operator> preds,
OperatorPlan lp) |
Modifier and Type | Method and Description |
---|---|
protected OperatorPlan |
WholePlanRule.buildPattern() |
protected OperatorPlan |
StreamTypeCastInserter.buildPattern() |
protected OperatorPlan |
SplitFilter.buildPattern() |
protected OperatorPlan |
PushUpFilter.buildPattern() |
protected OperatorPlan |
PushDownForEachFlatten.buildPattern() |
protected OperatorPlan |
PredicatePushdownOptimizer.buildPattern() |
protected OperatorPlan |
PartitionFilterOptimizer.buildPattern() |
protected OperatorPlan |
NestedLimitOptimizer.buildPattern() |
protected OperatorPlan |
MergeForEach.buildPattern() |
protected OperatorPlan |
MergeFilter.buildPattern() |
protected OperatorPlan |
LoadTypeCastInserter.buildPattern() |
protected OperatorPlan |
LimitOptimizer.buildPattern() |
protected OperatorPlan |
GroupByConstParallelSetter.buildPattern() |
protected OperatorPlan |
ForEachConstantCalculator.buildPattern() |
protected OperatorPlan |
FilterConstantCalculator.buildPattern() |
protected OperatorPlan |
FilterAboveForeach.buildPattern() |
OperatorPlan |
TypeCastInserter.TypeCastInserterTransformer.reportChanges() |
OperatorPlan |
SplitFilter.SplitFilterTransformer.reportChanges() |
OperatorPlan |
PushUpFilter.PushUpFilterTransformer.reportChanges() |
OperatorPlan |
PartitionFilterOptimizer.PartitionFilterPushDownTransformer.reportChanges() |
OperatorPlan |
NestedLimitOptimizer.OptimizeNestedLimitTransformer.reportChanges() |
OperatorPlan |
MergeForEach.MergeForEachTransformer.reportChanges() |
OperatorPlan |
MergeFilter.MergeFilterTransformer.reportChanges() |
OperatorPlan |
MapKeysPruneHelper.reportChanges() |
OperatorPlan |
LimitOptimizer.OptimizeLimitTransformer.reportChanges() |
OperatorPlan |
GroupByConstParallelSetter.GroupAllParallelSetterTransformer.reportChanges() |
OperatorPlan |
FilterAboveForeach.FilterAboveForEachTransformer.reportChanges() |
OperatorPlan |
ConstantCalculator.ConstantCalculatorTransformer.reportChanges() |
OperatorPlan |
ColumnPruneHelper.reportChanges() |
OperatorPlan |
ColumnMapKeyPrune.ColumnMapKeyPruneTransformer.reportChanges() |
OperatorPlan |
AddForEach.AddForEachTransformer.reportChanges() |
Modifier and Type | Method and Description |
---|---|
List<OperatorPlan> |
WholePlanRule.match(OperatorPlan plan) |
Modifier and Type | Method and Description |
---|---|
boolean |
TypeCastInserter.TypeCastInserterTransformer.check(OperatorPlan matched) |
boolean |
SplitFilter.SplitFilterTransformer.check(OperatorPlan matched) |
boolean |
PushUpFilter.PushUpFilterTransformer.check(OperatorPlan matched) |
boolean |
PartitionFilterOptimizer.PartitionFilterPushDownTransformer.check(OperatorPlan matched) |
boolean |
NestedLimitOptimizer.OptimizeNestedLimitTransformer.check(OperatorPlan matched) |
boolean |
MergeForEach.MergeForEachTransformer.check(OperatorPlan matched) |
boolean |
MergeFilter.MergeFilterTransformer.check(OperatorPlan matched) |
boolean |
LimitOptimizer.OptimizeLimitTransformer.check(OperatorPlan matched) |
boolean |
GroupByConstParallelSetter.GroupAllParallelSetterTransformer.check(OperatorPlan matched) |
boolean |
FilterAboveForeach.FilterAboveForEachTransformer.check(OperatorPlan matched) |
boolean |
ConstantCalculator.ConstantCalculatorTransformer.check(OperatorPlan matched) |
boolean |
ColumnMapKeyPrune.ColumnMapKeyPruneTransformer.check(OperatorPlan matched) |
boolean |
AddForEach.AddForEachTransformer.check(OperatorPlan matched) |
List<OperatorPlan> |
WholePlanRule.match(OperatorPlan plan) |
void |
TypeCastInserter.TypeCastInserterTransformer.transform(OperatorPlan matched) |
void |
SplitFilter.SplitFilterTransformer.transform(OperatorPlan matched) |
void |
PushUpFilter.PushUpFilterTransformer.transform(OperatorPlan matched) |
void |
PartitionFilterOptimizer.PartitionFilterPushDownTransformer.transform(OperatorPlan matched) |
void |
NestedLimitOptimizer.OptimizeNestedLimitTransformer.transform(OperatorPlan matched) |
void |
MergeForEach.MergeForEachTransformer.transform(OperatorPlan matched) |
void |
MergeFilter.MergeFilterTransformer.transform(OperatorPlan matched) |
void |
LimitOptimizer.OptimizeLimitTransformer.transform(OperatorPlan matched) |
void |
GroupByConstParallelSetter.GroupAllParallelSetterTransformer.transform(OperatorPlan plan) |
void |
FilterAboveForeach.FilterAboveForEachTransformer.transform(OperatorPlan matched) |
void |
ConstantCalculator.ConstantCalculatorTransformer.transform(OperatorPlan matched) |
void |
ColumnMapKeyPrune.ColumnMapKeyPruneTransformer.transform(OperatorPlan matched) |
void |
AddForEach.AddForEachTransformer.transform(OperatorPlan matched) |
Constructor and Description |
---|
ColumnPruneHelper(OperatorPlan currentPlan) |
ColumnPruneVisitor(OperatorPlan plan,
Map<LOLoad,Pair<Map<Integer,Set<String>>,Set<Integer>>> requiredItems,
boolean columnPrune) |
ConstantCalculatorExpressionVisitor(OperatorPlan expPlan,
LogicalRelationalOperator currentOp,
PigContext pc) |
ConstantCalculatorLogicalPlanVisitor(OperatorPlan plan,
PigContext pc) |
FullMapCollector(OperatorPlan plan,
Set<Long> fullMapUids) |
MapKeysPruneHelper(OperatorPlan currentPlan) |
MapMarker(OperatorPlan plan) |
Modifier and Type | Field and Description |
---|---|
protected OperatorPlan |
Rule.currentPlan |
protected OperatorPlan |
Rule.pattern |
protected OperatorPlan |
PlanOptimizer.plan |
Modifier and Type | Method and Description |
---|---|
protected abstract OperatorPlan |
Rule.buildPattern()
Build the pattern that this rule will look for
|
OperatorPlan |
Rule.getPattern()
Return the pattern to be matched for this rule
|
abstract OperatorPlan |
Transformer.reportChanges()
Report what parts of the tree were transformed.
|
Modifier and Type | Method and Description |
---|---|
List<OperatorPlan> |
Rule.match(OperatorPlan plan)
Search for all the sub-plans that matches the pattern
defined by this rule.
|
Modifier and Type | Method and Description |
---|---|
abstract boolean |
Transformer.check(OperatorPlan matched)
check if the transform should be done.
|
List<OperatorPlan> |
Rule.match(OperatorPlan plan)
Search for all the sub-plans that matches the pattern
defined by this rule.
|
abstract void |
Transformer.transform(OperatorPlan matched)
Transform the tree
|
void |
PlanTransformListener.transformed(OperatorPlan fp,
OperatorPlan tp)
Notification that a plan has been transformed.
|
Constructor and Description |
---|
PlanOptimizer(OperatorPlan p,
List<Set<Rule>> rs,
int iterations) |
Rule(String n,
OperatorPlan p) |
Constructor and Description |
---|
AugmentBaseDataVisitor(OperatorPlan plan,
Map<Operator,PhysicalOperator> logToPhysMap,
Map<LOLoad,DataBag> baseData,
Map<Operator,DataBag> derivedData) |
POOptimizeDisabler(OperatorPlan plan) |
Modifier and Type | Method and Description |
---|---|
PlanWalker |
PreOrderDepthFirstWalker.spawnChildWalker(OperatorPlan plan) |
Constructor and Description |
---|
PreOrderDepthFirstWalker(OperatorPlan plan) |
Modifier and Type | Class and Description |
---|---|
static class |
PigStats.JobGraph
JobGraph is an
OperatorPlan whose members are JobStats |
Constructor and Description |
---|
JobGraphPrinter(OperatorPlan plan) |
Constructor and Description |
---|
BlackAndWhitelistValidator(PigContext pigContext,
OperatorPlan operatorPlan) |
Copyright © 2007-2017 The Apache Software Foundation