org.apache.pig.backend.hadoop.executionengine.spark.plan

Class SparkPOPackageAnnotator

java.lang.Object

org.apache.pig.impl.plan.PlanVisitor<SparkOperator,SparkOperPlan>

org.apache.pig.backend.hadoop.executionengine.spark.plan.SparkOpPlanVisitor

org.apache.pig.backend.hadoop.executionengine.spark.plan.SparkPOPackageAnnotator

public class SparkPOPackageAnnotator
extends SparkOpPlanVisitor

This visitor visits the SparkPlan and does the following for each SparkOperator - visits the POPackage in the plan and finds the corresponding POLocalRearrange(s). It then annotates the POPackage with information about which columns in the "value" are present in the "key" and will need to stitched in to the "value"

Field Summary

Fields inherited from class org.apache.pig.impl.plan.PlanVisitor

mCurrentWalker, mPlan

Constructor Summary

Constructors

Constructor and Description
SparkPOPackageAnnotator(SparkOperPlan plan)

Method Summary

Modifier and Type	Method and Description
void	visitSparkOp(SparkOperator sparkOp)

Methods inherited from class org.apache.pig.impl.plan.PlanVisitor

getPlan, popWalker, pushWalker, visit

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkPOPackageAnnotator

public SparkPOPackageAnnotator(SparkOperPlan plan)

Method Detail

visitSparkOp

public void visitSparkOp(SparkOperator sparkOp)
                  throws VisitorException

Overrides:

visitSparkOp in class SparkOpPlanVisitor

Throws:

VisitorException