org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators

Class POForEach

java.lang.Object

org.apache.pig.impl.plan.Operator<PhyPlanVisitor>

org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.lang.Comparable<Operator>, Illustrable

Direct Known Subclasses:

POOptimizedForEach

public class POForEach
extends PhysicalOperator

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

PhysicalOperator.OriginalLocation

Field Summary

Fields

Modifier and Type	Field and Description
protected java.lang.Object[]	bags
protected AccumulativeTupleBuffer	buffer
protected java.lang.Object[]	data
protected java.util.BitSet	earlyTermination
protected Tuple	inpTuple
protected java.util.List<PhysicalPlan>	inputPlans
protected boolean[]	isToBeFlattenedArray
protected java.util.Iterator<Tuple>[]	its
protected boolean	mapSideOnly
protected int	noItems
protected java.util.List<PhysicalOperator>	opsToBeReset
protected PhysicalOperator[]	planLeafOps
protected boolean	processingPlan
protected byte[]	resultTypes

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

alias, illustrator, input, inputAttached, inputs, lineageTracer, outputs, parentPlan, pigLogger, reporter, requestedParallelism, res, RESULT_EMPTY, RESULT_EOP, resultType

Fields inherited from class org.apache.pig.impl.plan.Operator

mKey

Constructor Summary

Constructors

Constructor and Description
POForEach(OperatorKey k)
POForEach(OperatorKey k, int rp)
POForEach(OperatorKey k, int rp, java.util.List<PhysicalPlan> inp, java.util.List<java.lang.Boolean> isToBeFlattened)
POForEach(OperatorKey operatorKey, int requestedParallelism, java.util.List<PhysicalPlan> innerPlans, java.util.List<java.lang.Boolean> flattenList, Schema schema)
POForEach(OperatorKey k, java.util.List inp)

Method Summary

Methods

Modifier and Type	Method and Description
void	addInputPlan(PhysicalPlan plan, boolean flatten)
protected void	attachInputToPlans(Tuple t)
POForEach	clone() Make a deep copy of this operator.
protected Tuple	createTuple(java.lang.Object[] data)
java.util.List<PhysicalPlan>	getInputPlans()
void	getLeaves()
Result	getNextTuple() Calls getNext on the generate operator inside the nested physical plan and returns it maintaining an additional state to denote the begin and end of the nested plan processing.
java.util.List<PhysicalOperator>	getOpsToBeReset()
java.util.List<java.lang.Boolean>	getToBeFlattened()
Tuple	illustratorMarkup(java.lang.Object in, java.lang.Object out, int eqClassIndex) input tuple mark up to be illustrate-able
boolean	inProcessing()
boolean	isMapSideOnly()
java.lang.String	name()
protected Result	processPlan()
void	setAccumEnd()
void	setAccumStart()
void	setAccumulative()
void	setInputPlans(java.util.List<PhysicalPlan> plans)
void	setMapSideOnly(boolean mapSideOnly)
void	setOpsToBeReset(java.util.List<PhysicalOperator> opsToBeReset)
void	setToBeFlattened(java.util.List<java.lang.Boolean> flattens)
protected void	setUpFlattens(java.util.List<java.lang.Boolean> isToBeFlattened)
boolean	supportsMultipleInputs() Indicates whether this operator supports multiple inputs.
boolean	supportsMultipleOutputs() Indicates whether this operator supports multiple outputs.
void	visit(PhyPlanVisitor v) Visit this node with the provided visitor.

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

addOriginalLocation, addOriginalLocation, attachInput, cloneHelper, copyAliasFrom, detachInput, getAlias, getAliasString, getIllustrator, getInputs, getLogger, getNext, getNextBigDecimal, getNextBigInteger, getNextBoolean, getNextDataBag, getNextDataByteArray, getNextDateTime, getNextDouble, getNextFloat, getNextInteger, getNextLong, getNextMap, getNextString, getOriginalLocations, getPigLogger, getReporter, getRequestedParallelism, getResultType, isAccumStarted, isAccumulative, isBlocking, isInputAttached, processInput, reset, setIllustrator, setInputs, setParentPlan, setPigLogger, setReporter, setRequestedParallelism, setResultType, staticDataCleanup

Methods inherited from class org.apache.pig.impl.plan.Operator

compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, toString, unsetProjectionMap

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

inputPlans

protected java.util.List<PhysicalPlan> inputPlans

opsToBeReset

protected java.util.List<PhysicalOperator> opsToBeReset

processingPlan

protected boolean processingPlan

its

protected transient java.util.Iterator<Tuple>[] its

bags

protected java.lang.Object[] bags

data

protected java.lang.Object[] data

resultTypes

protected byte[] resultTypes

earlyTermination

protected java.util.BitSet earlyTermination

isToBeFlattenedArray

protected boolean[] isToBeFlattenedArray

noItems

protected int noItems

planLeafOps

protected PhysicalOperator[] planLeafOps

buffer

protected transient AccumulativeTupleBuffer buffer

inpTuple

protected Tuple inpTuple

mapSideOnly

protected boolean mapSideOnly

Constructor Detail

POForEach

public POForEach(OperatorKey k)

POForEach

public POForEach(OperatorKey k,
         int rp)

POForEach

public POForEach(OperatorKey k,
         java.util.List inp)

POForEach

public POForEach(OperatorKey k,
         int rp,
         java.util.List<PhysicalPlan> inp,
         java.util.List<java.lang.Boolean> isToBeFlattened)

POForEach

public POForEach(OperatorKey operatorKey,
         int requestedParallelism,
         java.util.List<PhysicalPlan> innerPlans,
         java.util.List<java.lang.Boolean> flattenList,
         Schema schema)

Method Detail

visit

public void visit(PhyPlanVisitor v)
           throws VisitorException

Description copied from class: Operator

Visit this node with the provided visitor. This should only be called by the visitor class itself, never directly.

Specified by:

visit in class PhysicalOperator

Parameters:

v - Visitor to visit with.

Throws:

VisitorException - if the visitor has a problem.

name

public java.lang.String name()

Specified by:

name in class Operator<PhyPlanVisitor>

supportsMultipleInputs

public boolean supportsMultipleInputs()

Description copied from class: Operator

Indicates whether this operator supports multiple inputs.

Specified by:

supportsMultipleInputs in class Operator<PhyPlanVisitor>

Returns:

true if it does, otherwise false.

supportsMultipleOutputs

public boolean supportsMultipleOutputs()

Description copied from class: Operator

Indicates whether this operator supports multiple outputs.

Specified by:

supportsMultipleOutputs in class Operator<PhyPlanVisitor>

Returns:

true if it does, otherwise false.

setAccumulative

public void setAccumulative()

Overrides:

setAccumulative in class PhysicalOperator

setAccumStart

public void setAccumStart()

Overrides:

setAccumStart in class PhysicalOperator

setAccumEnd

public void setAccumEnd()

Overrides:

setAccumEnd in class PhysicalOperator

getNextTuple

public Result getNextTuple()
                    throws ExecException

Calls getNext on the generate operator inside the nested physical plan and returns it maintaining an additional state to denote the begin and end of the nested plan processing.

Overrides:

getNextTuple in class PhysicalOperator

Throws:

ExecException

processPlan

protected Result processPlan()
                      throws ExecException

Throws:

ExecException

createTuple

protected Tuple createTuple(java.lang.Object[] data)
                     throws ExecException

Parameters:

data - array that is the template for the final flattened tuple

Returns:

the final flattened tuple

Throws:

ExecException

attachInputToPlans

protected void attachInputToPlans(Tuple t)

getLeaves

public void getLeaves()

getInputPlans

public java.util.List<PhysicalPlan> getInputPlans()

setInputPlans

public void setInputPlans(java.util.List<PhysicalPlan> plans)

addInputPlan

public void addInputPlan(PhysicalPlan plan,
                boolean flatten)

setToBeFlattened

public void setToBeFlattened(java.util.List<java.lang.Boolean> flattens)

getToBeFlattened

public java.util.List<java.lang.Boolean> getToBeFlattened()

clone

public POForEach clone()
                throws java.lang.CloneNotSupportedException

Make a deep copy of this operator.

Overrides:

clone in class PhysicalOperator

Throws:

java.lang.CloneNotSupportedException

See Also:

Do not use the clone method directly. Operators are cloned when logical plans are cloned using {@link LogicalPlanCloner}

inProcessing

public boolean inProcessing()

setUpFlattens

protected void setUpFlattens(java.util.List<java.lang.Boolean> isToBeFlattened)

getOpsToBeReset

public java.util.List<PhysicalOperator> getOpsToBeReset()

Returns:

the opsToBeReset

setOpsToBeReset

public void setOpsToBeReset(java.util.List<PhysicalOperator> opsToBeReset)

Parameters:

opsToBeReset - the opsToBeReset to set

illustratorMarkup

public Tuple illustratorMarkup(java.lang.Object in,
                      java.lang.Object out,
                      int eqClassIndex)

Description copied from interface: Illustrable

input tuple mark up to be illustrate-able

Parameters:

in - input tuple

out - output tuple before wrapped in ExampleTuple

eqClassIndex - index into equivalence classes in illustrator

Returns:

tuple

setMapSideOnly

public void setMapSideOnly(boolean mapSideOnly)

isMapSideOnly

public boolean isMapSideOnly()