org.apache.pig.backend.hadoop.executionengine.tez.plan.operator

Class POIdentityInOutTez

java.lang.Object

org.apache.pig.impl.plan.Operator<PhyPlanVisitor>

org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange

org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POLocalRearrangeTez

org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POIdentityInOutTez

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.lang.Comparable<Operator>, TezInput, TezOutput, Illustrable

@InterfaceAudience.Private
public class POIdentityInOutTez
extends POLocalRearrangeTez
implements TezInput, TezOutput

POIdentityInOutTez is used to pass through tuples as is to next vertex from previous vertex's POLocalRearrangeTez. For eg: In case of Order By, the partition vertex which just applies the WeightedRangePartitioner on the previous vertex data uses POIdentityInOutTez.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

PhysicalOperator.OriginalLocation

Field Summary

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POLocalRearrangeTez

connectedToPackage, isSkewedJoin, outputKey, writer

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange

index, inp, isCross, keyType, leafOps, mainKeyType, mFakeTuple, mIsDistinct, mTupleFactory, plans, secondaryKeyType, secondaryLeafOps, secondaryPlans

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

alias, illustrator, input, inputAttached, inputs, lineageTracer, outputs, parentPlan, pigLogger, reporter, requestedParallelism, res, RESULT_EMPTY, RESULT_EOP, resultType

Fields inherited from class org.apache.pig.impl.plan.Operator

mKey

Constructor Summary

Constructors

Constructor and Description
POIdentityInOutTez(OperatorKey k, POLocalRearrange inputRearrange)

Method Summary

Methods

Modifier and Type	Method and Description
void	addInputsToSkip(java.util.Set<java.lang.String> inputsToSkip) Add to the list of inputs to skip download if already available in vertex cache
void	attachInputs(java.util.Map<java.lang.String,LogicalInput> inputs, org.apache.hadoop.conf.Configuration conf)
void	attachOutputs(java.util.Map<java.lang.String,LogicalOutput> outputs, org.apache.hadoop.conf.Configuration conf)
Result	getNextTuple() Calls getNext on the generate operator inside the nested physical plan.
java.lang.String[]	getTezInputs()
java.lang.String	name()
void	replaceInput(java.lang.String oldInputKey, java.lang.String newInputKey)
void	setInputKey(java.lang.String inputKey)

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POLocalRearrangeTez

clone, getOutputKey, getTezOutputs, isConnectedToPackage, isSkewedJoin, replaceOutput, setConnectedToPackage, setOutputKey, setSkewedJoin

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange

attachInput, constructLROutput, deepCopyTo, getIndex, getKeyFromResult, getKeyType, getMainKeyType, getPlans, getProjectedColsMap, getSecondaryProjectedColsMap, illustratorMarkup, isCross, isDistinct, isKeyCompound, isKeyTuple, isProjectStar, isSecondaryKeyTuple, isSecondaryProjectStar, setCross, setDistinct, setIndex, setKeyType, setMultiQueryIndex, setPlans, setPlansFromCombiner, setSecondaryPlans, setStripKeyFromValue, setUseSecondaryKey, supportsMultipleInputs, supportsMultipleOutputs, visit

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

addOriginalLocation, addOriginalLocation, cloneHelper, copyAliasFrom, detachInput, getAlias, getAliasString, getIllustrator, getInputs, getLogger, getNext, getNextBigDecimal, getNextBigInteger, getNextBoolean, getNextDataBag, getNextDataByteArray, getNextDateTime, getNextDouble, getNextFloat, getNextInteger, getNextLong, getNextMap, getNextString, getOriginalLocations, getPigLogger, getReporter, getRequestedParallelism, getResultType, isAccumStarted, isAccumulative, isBlocking, isInputAttached, processInput, reset, setAccumEnd, setAccumStart, setAccumulative, setIllustrator, setInputs, setParentPlan, setPigLogger, setReporter, setRequestedParallelism, setResultType, staticDataCleanup

Methods inherited from class org.apache.pig.impl.plan.Operator

compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, toString, unsetProjectionMap

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.pig.backend.hadoop.executionengine.tez.runtime.TezOutput

getTezOutputs, replaceOutput

Constructor Detail

POIdentityInOutTez

public POIdentityInOutTez(OperatorKey k,
                  POLocalRearrange inputRearrange)

Method Detail

setInputKey

public void setInputKey(java.lang.String inputKey)

getTezInputs

public java.lang.String[] getTezInputs()

Specified by:

getTezInputs in interface TezInput

replaceInput

public void replaceInput(java.lang.String oldInputKey,
                java.lang.String newInputKey)

Specified by:

replaceInput in interface TezInput

addInputsToSkip

public void addInputsToSkip(java.util.Set<java.lang.String> inputsToSkip)

Description copied from interface: TezInput

Add to the list of inputs to skip download if already available in vertex cache

Specified by:

addInputsToSkip in interface TezInput

attachInputs

public void attachInputs(java.util.Map<java.lang.String,LogicalInput> inputs,
                org.apache.hadoop.conf.Configuration conf)
                  throws ExecException

Specified by:

attachInputs in interface TezInput

Throws:

ExecException

attachOutputs

public void attachOutputs(java.util.Map<java.lang.String,LogicalOutput> outputs,
                 org.apache.hadoop.conf.Configuration conf)
                   throws ExecException

Specified by:

attachOutputs in interface TezOutput

Overrides:

attachOutputs in class POLocalRearrangeTez

Throws:

ExecException

getNextTuple

public Result getNextTuple()
                    throws ExecException

Description copied from class: POLocalRearrange

Calls getNext on the generate operator inside the nested physical plan. Converts the generated tuple into the proper format, i.e, (key,indexedTuple(value))

Overrides:

getNextTuple in class POLocalRearrangeTez

Throws:

ExecException

name

public java.lang.String name()

Overrides:

name in class POLocalRearrangeTez