org.apache.pig.backend.hadoop.executionengine.spark.plan

Class DotSparkPrinter

java.lang.Object

org.apache.pig.impl.plan.PlanDumper<E,P,S>

org.apache.pig.impl.plan.DotPlanDumper<SparkOperator,SparkOperPlan,DotSparkPrinter.InnerOperator,DotSparkPrinter.InnerPlan>

org.apache.pig.backend.hadoop.executionengine.spark.plan.DotSparkPrinter

public class DotSparkPrinter
extends DotPlanDumper<SparkOperator,SparkOperPlan,DotSparkPrinter.InnerOperator,DotSparkPrinter.InnerPlan>

This class can print Spark plan in the DOT format. It uses clusters to illustrate nesting. If "verbose" is off, it will skip any nesting in the associated physical plans.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DotSparkPrinter.InnerOperator Helper class to represent the relationship of inner operators
static class	DotSparkPrinter.InnerPlan Each spark operator will have and an inner plan of inner operators.

Field Summary

Fields inherited from class org.apache.pig.impl.plan.DotPlanDumper

mMultiInputSubgraphs, mMultiOutputSubgraphs, mSubgraphs

Fields inherited from class org.apache.pig.impl.plan.PlanDumper

isVerbose, plan, ps

Constructor Summary

Constructors

Constructor and Description
DotSparkPrinter(SparkOperPlan plan, java.io.PrintStream ps)

Method Summary

Modifier and Type	Method and Description
protected java.lang.String[]	getAttributes(SparkOperator op) Used to generate the the attributes of a node
protected java.lang.String	getName(SparkOperator op) Used to generate the label for an operator.
protected java.util.Collection<DotSparkPrinter.InnerPlan>	getNestedPlans(SparkOperator op) Used to determine if an operator has nested plans (without connections to in- or output operators.
protected DotPlanDumper	makeDumper(DotSparkPrinter.InnerPlan plan, java.io.PrintStream ps) makeDumper is a factory method.
void	setVerbose(boolean verbose)

Methods inherited from class org.apache.pig.impl.plan.DotPlanDumper

dump, dumpEdge, dumpInvisibleOperators, dumpMultiInputNestedOperator, dumpMultiOutputNestedOperator, dumpNestedOperator, dumpOperator

Methods inherited from class org.apache.pig.impl.plan.PlanDumper

getMultiInputNestedPlans, getMultiOutputNestedPlans, isVerbose, join

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DotSparkPrinter

public DotSparkPrinter(SparkOperPlan plan,
                       java.io.PrintStream ps)

Method Detail

setVerbose

public void setVerbose(boolean verbose)

Overrides:

setVerbose in class PlanDumper<SparkOperator,SparkOperPlan,DotSparkPrinter.InnerPlan>

makeDumper

protected DotPlanDumper makeDumper(DotSparkPrinter.InnerPlan plan,
                                   java.io.PrintStream ps)

Description copied from class: PlanDumper

makeDumper is a factory method. Used by subclasses to specify what dumper should handle the nested plan.

Overrides:

makeDumper in class DotPlanDumper<SparkOperator,SparkOperPlan,DotSparkPrinter.InnerOperator,DotSparkPrinter.InnerPlan>

Parameters:

plan - Plan that the new dumper should handle

Returns:

the dumper for plan

getName

protected java.lang.String getName(SparkOperator op)

Description copied from class: DotPlanDumper

Used to generate the label for an operator.

Overrides:

getName in class DotPlanDumper<SparkOperator,SparkOperPlan,DotSparkPrinter.InnerOperator,DotSparkPrinter.InnerPlan>

Parameters:

op - operator to dump

getNestedPlans

protected java.util.Collection<DotSparkPrinter.InnerPlan> getNestedPlans(SparkOperator op)

Description copied from class: PlanDumper

Used to determine if an operator has nested plans (without connections to in- or output operators.

Overrides:

getNestedPlans in class PlanDumper<SparkOperator,SparkOperPlan,DotSparkPrinter.InnerPlan>

Parameters:

op - operator

Returns:

Collection of nested plans.

getAttributes

protected java.lang.String[] getAttributes(SparkOperator op)

Description copied from class: DotPlanDumper

Used to generate the the attributes of a node

Overrides:

getAttributes in class DotPlanDumper<SparkOperator,SparkOperPlan,DotSparkPrinter.InnerOperator,DotSparkPrinter.InnerPlan>

Parameters:

op - operator