org.apache.pig.backend.hadoop.executionengine.spark.optimizer

Class JoinGroupOptimizerSpark

java.lang.Object

org.apache.pig.impl.plan.PlanVisitor<SparkOperator,SparkOperPlan>

org.apache.pig.backend.hadoop.executionengine.spark.plan.SparkOpPlanVisitor

org.apache.pig.backend.hadoop.executionengine.spark.optimizer.JoinGroupOptimizerSpark

public class JoinGroupOptimizerSpark
extends SparkOpPlanVisitor

Collapse LocalRearrange,GlobalRearrange,Package to POJoinGroupSpark to reduce unnecessary map operations to optimize join/group. Detail see PIG-4797

Field Summary

Fields inherited from class org.apache.pig.impl.plan.PlanVisitor

mCurrentWalker, mPlan

Constructor Summary

Constructors

Constructor and Description
JoinGroupOptimizerSpark(SparkOperPlan plan)

Method Summary

Modifier and Type	Method and Description
void	visitSparkOp(SparkOperator sparkOp)

Methods inherited from class org.apache.pig.impl.plan.PlanVisitor

getPlan, popWalker, pushWalker, visit

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

JoinGroupOptimizerSpark

public JoinGroupOptimizerSpark(SparkOperPlan plan)

Method Detail

visitSparkOp

public void visitSparkOp(SparkOperator sparkOp)
                  throws VisitorException

Overrides:

visitSparkOp in class SparkOpPlanVisitor

Throws:

VisitorException