org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators

Class POPartitionRearrange

java.lang.Object

org.apache.pig.impl.plan.Operator<PhyPlanVisitor>

org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange

org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPartitionRearrange

All Implemented Interfaces:

Serializable, Cloneable, Comparable<Operator>, Illustrable

public class POPartitionRearrange
extends POLocalRearrange

The partition rearrange operator is a part of the skewed join implementation. It has an embedded physical plan that generates tuples of the form (inpKey,reducerIndex,(indxed inp Tuple)).

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

PhysicalOperator.OriginalLocation

Field Summary

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange

index, inp, isCross, keyType, leafOps, mainKeyType, mFakeTuple, mIsDistinct, plans, secondaryKeyType, secondaryLeafOps, secondaryPlans

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

alias, illustrator, input, inputAttached, inputs, lineageTracer, mBagFactory, mTupleFactory, outputs, parentPlan, pigLogger, reporter, requestedParallelism, res, RESULT_EMPTY, RESULT_EOP, resultType

Fields inherited from class org.apache.pig.impl.plan.Operator

mKey

Constructor Summary

Constructors

Constructor and Description
POPartitionRearrange(OperatorKey k)
POPartitionRearrange(OperatorKey k, int rp)
POPartitionRearrange(OperatorKey k, int rp, List<PhysicalOperator> inp)
POPartitionRearrange(OperatorKey k, List<PhysicalOperator> inp)

Method Summary

Modifier and Type	Method and Description
POPartitionRearrange	clone() Make a deep copy of this operator.
protected DataBag	constructPROutput(List<Result> resLst, Tuple value)
Result	getNextTuple() Calls getNext on the generate operator inside the nested physical plan.
PigContext	getPigContext()
String	name()
void	setPigContext(PigContext pigContext)

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange

attachInput, constructLROutput, getIndex, getKeyFromResult, getKeyType, getMainKeyType, getPlans, getProjectedColsMap, getSecondaryProjectedColsMap, illustratorMarkup, isCross, isDistinct, isKeyCompound, isKeyTuple, isProjectStar, isSecondaryKeyTuple, isSecondaryProjectStar, setCross, setDistinct, setIndex, setKeyType, setMultiQueryIndex, setPlans, setPlansFromCombiner, setSecondaryPlans, setStripKeyFromValue, setUseSecondaryKey, supportsMultipleInputs, supportsMultipleOutputs, visit

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

addOriginalLocation, addOriginalLocation, cloneHelper, clonePlans, copyAliasFrom, detachInput, getAlias, getAliasString, getIllustrator, getInputs, getLogger, getNext, getNextBigDecimal, getNextBigInteger, getNextBoolean, getNextDataBag, getNextDataByteArray, getNextDateTime, getNextDouble, getNextFloat, getNextInteger, getNextLong, getNextMap, getNextString, getOriginalLocations, getParentPlan, getPigLogger, getReporter, getRequestedParallelism, getResultType, isAccumStarted, isAccumulative, isBlocking, isEndOfAllInput, isInputAttached, processInput, reset, setAccumEnd, setAccumStart, setAccumulative, setIllustrator, setInputs, setParentPlan, setPigLogger, setReporter, setRequestedParallelism, setResultType, staticDataCleanup

Methods inherited from class org.apache.pig.impl.plan.Operator

compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, toString, unsetProjectionMap

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

POPartitionRearrange

public POPartitionRearrange(OperatorKey k)

POPartitionRearrange

public POPartitionRearrange(OperatorKey k,
                            int rp)

POPartitionRearrange

public POPartitionRearrange(OperatorKey k,
                            List<PhysicalOperator> inp)

POPartitionRearrange

public POPartitionRearrange(OperatorKey k,
                            int rp,
                            List<PhysicalOperator> inp)

Method Detail

name

public String name()

Overrides:

name in class POLocalRearrange

getNextTuple

public Result getNextTuple()
                    throws ExecException

Calls getNext on the generate operator inside the nested physical plan. Converts the generated tuple into the proper format, i.e, (key,indexedTuple(value))

Overrides:

getNextTuple in class POLocalRearrange

Throws:

ExecException

constructPROutput

protected DataBag constructPROutput(List<Result> resLst,
                                    Tuple value)
                             throws ExecException

Throws:

ExecException

setPigContext

public void setPigContext(PigContext pigContext)

Parameters:

pigContext - the pigContext to set

getPigContext

public PigContext getPigContext()

Returns:

the pigContext

clone

public POPartitionRearrange clone()
                           throws CloneNotSupportedException

Make a deep copy of this operator.

Overrides:

clone in class POLocalRearrange

Throws:

CloneNotSupportedException

See Also:

Do not use the clone method directly. Operators are cloned when logical plans are cloned using {@link LogicalPlanCloner}