org.apache.pig.backend.hadoop.executionengine.tez.plan.operator

Class POLocalRearrangeTez

java.lang.Object

org.apache.pig.impl.plan.Operator<PhyPlanVisitor>

org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange

org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POLocalRearrangeTez

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.lang.Comparable<Operator>, TezOutput, Illustrable

Direct Known Subclasses:

POBloomFilterRearrangeTez, POBuildBloomRearrangeTez, POIdentityInOutTez, POPartitionRearrangeTez

public class POLocalRearrangeTez
extends POLocalRearrange
implements TezOutput

POLocalRearrangeTez is used to write to a Tez OrderedPartitionedKVOutput (shuffle) or UnorderedKVOutput (broadcast)

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

PhysicalOperator.OriginalLocation

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	connectedToPackage
protected boolean	isSkewedJoin
protected java.lang.String	outputKey
protected org.apache.tez.runtime.library.api.KeyValueWriter	writer

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange

index, inp, isCross, keyType, leafOps, mainKeyType, mFakeTuple, mIsDistinct, plans, secondaryKeyType, secondaryLeafOps, secondaryPlans

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

alias, illustrator, input, inputAttached, inputs, lineageTracer, mBagFactory, mTupleFactory, outputs, parentPlan, pigLogger, reporter, requestedParallelism, res, RESULT_EMPTY, RESULT_EOP, resultType

Fields inherited from class org.apache.pig.impl.plan.Operator

mKey

Constructor Summary

Constructors

Constructor and Description
POLocalRearrangeTez(OperatorKey k)
POLocalRearrangeTez(OperatorKey k, int rp)
POLocalRearrangeTez(POLocalRearrange copy)

Method Summary

Modifier and Type	Method and Description
void	attachOutputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalOutput> outputs, org.apache.hadoop.conf.Configuration conf)
POLocalRearrangeTez	clone() Make a deep copy of this operator.
boolean	containsOutputKey(java.lang.String key)
Result	getNextTuple() Calls getNext on the generate operator inside the nested physical plan.
protected Result	getRearrangedTuple()
java.lang.String[]	getTezOutputs()
boolean	isConnectedToPackage()
boolean	isSkewedJoin()
java.lang.String	name()
void	replaceOutput(java.lang.String oldOutputKey, java.lang.String newOutputKey)
void	setConnectedToPackage(boolean connectedToPackage)
void	setOutputKey(java.lang.String outputKey)
void	setSkewedJoin(boolean isSkewedJoin)

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange

attachInput, constructLROutput, getIndex, getKeyFromResult, getKeyType, getMainKeyType, getPlans, getProjectedColsMap, getSecondaryProjectedColsMap, illustratorMarkup, isCross, isDistinct, isKeyCompound, isKeyTuple, isProjectStar, isSecondaryKeyTuple, isSecondaryProjectStar, setCross, setDistinct, setIndex, setKeyType, setMultiQueryIndex, setPlans, setPlansFromCombiner, setSecondaryPlans, setStripKeyFromValue, setUseSecondaryKey, supportsMultipleInputs, supportsMultipleOutputs, visit

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

addOriginalLocation, addOriginalLocation, cloneHelper, clonePlans, copyAliasFrom, detachInput, getAlias, getAliasString, getIllustrator, getInputs, getLogger, getNext, getNextBigDecimal, getNextBigInteger, getNextBoolean, getNextDataBag, getNextDataByteArray, getNextDateTime, getNextDouble, getNextFloat, getNextInteger, getNextLong, getNextMap, getNextString, getOriginalLocations, getParentPlan, getPigLogger, getReporter, getRequestedParallelism, getResultType, isAccumStarted, isAccumulative, isBlocking, isEndOfAllInput, isInputAttached, processInput, reset, setAccumEnd, setAccumStart, setAccumulative, setIllustrator, setInputs, setParentPlan, setPigLogger, setReporter, setRequestedParallelism, setResultType, staticDataCleanup

Methods inherited from class org.apache.pig.impl.plan.Operator

compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, toString, unsetProjectionMap

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

outputKey

protected java.lang.String outputKey

connectedToPackage

protected boolean connectedToPackage

isSkewedJoin

protected boolean isSkewedJoin

writer

protected transient org.apache.tez.runtime.library.api.KeyValueWriter writer

Constructor Detail

POLocalRearrangeTez

public POLocalRearrangeTez(OperatorKey k)

POLocalRearrangeTez

public POLocalRearrangeTez(OperatorKey k,
                           int rp)

POLocalRearrangeTez

public POLocalRearrangeTez(POLocalRearrange copy)

Method Detail

containsOutputKey

public boolean containsOutputKey(java.lang.String key)

setOutputKey

public void setOutputKey(java.lang.String outputKey)

isConnectedToPackage

public boolean isConnectedToPackage()

setConnectedToPackage

public void setConnectedToPackage(boolean connectedToPackage)

isSkewedJoin

public boolean isSkewedJoin()

setSkewedJoin

public void setSkewedJoin(boolean isSkewedJoin)

getTezOutputs

public java.lang.String[] getTezOutputs()

Specified by:

getTezOutputs in interface TezOutput

replaceOutput

public void replaceOutput(java.lang.String oldOutputKey,
                          java.lang.String newOutputKey)

Specified by:

replaceOutput in interface TezOutput

attachOutputs

public void attachOutputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalOutput> outputs,
                          org.apache.hadoop.conf.Configuration conf)
                   throws ExecException

Specified by:

attachOutputs in interface TezOutput

Throws:

ExecException

getRearrangedTuple

protected Result getRearrangedTuple()
                             throws ExecException

Throws:

ExecException

getNextTuple

public Result getNextTuple()
                    throws ExecException

Description copied from class: POLocalRearrange

Calls getNext on the generate operator inside the nested physical plan. Converts the generated tuple into the proper format, i.e, (key,indexedTuple(value))

Overrides:

getNextTuple in class POLocalRearrange

Throws:

ExecException

clone

public POLocalRearrangeTez clone()
                          throws java.lang.CloneNotSupportedException

Description copied from class: POLocalRearrange

Make a deep copy of this operator.

Overrides:

clone in class POLocalRearrange

Throws:

java.lang.CloneNotSupportedException

See Also:

Do not use the clone method directly. Operators are cloned when logical plans are cloned using {@link LogicalPlanCloner}

name

public java.lang.String name()

Overrides:

name in class POLocalRearrange