org.apache.pig.backend.hadoop.executionengine.tez.plan.operator

Class POFRJoinTez

java.lang.Object

org.apache.pig.impl.plan.Operator<PhyPlanVisitor>

org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFRJoin

org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POFRJoinTez

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.lang.Comparable<Operator>, TezInput, Illustrable

public class POFRJoinTez
extends POFRJoin
implements TezInput

POFRJoinTez is used on the backend to load replicated table from Tez ShuffleUnorderedKVInput and load fragmented table from data pipeline.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFRJoin

POFRJoin.TupleToMapKey

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

PhysicalOperator.OriginalLocation

Field Summary

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFRJoin

constExps, dumTup, fe, fragment, inputSchemas, isLeftOuterJoin, keySchemas, keyTypes, LRs, nullBag, phyPlanLists, processingPlan, replFiles, replicates, setUp

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

alias, illustrator, input, inputAttached, inputs, lineageTracer, mBagFactory, mTupleFactory, outputs, parentPlan, pigLogger, reporter, requestedParallelism, res, RESULT_EMPTY, RESULT_EOP, resultType

Fields inherited from class org.apache.pig.impl.plan.Operator

mKey

Constructor Summary

Constructors

Constructor and Description
POFRJoinTez(POFRJoin copy, java.util.List<java.lang.String> inputKeys)

Method Summary

Modifier and Type	Method and Description
void	addInputsToSkip(java.util.Set<java.lang.String> inputsToSkip) Add to the list of inputs to skip download if already available in vertex cache
void	attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs, org.apache.hadoop.conf.Configuration conf) Attach the inputs to the operator.
POFRJoinTez	clone() Make a copy of this operator.
java.util.List<java.lang.String>	getInputKeys()
java.lang.String[]	getTezInputs()
java.lang.String	name()
void	replaceInput(java.lang.String oldInputKey, java.lang.String newInputKey)
protected void	setUpHashMap() Builds the HashMaps by reading replicated inputs from broadcast edges

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFRJoin

getFragment, getJoinPlans, getLRs, getNextTuple, getReplFiles, getValueTuple, illustratorMarkup, isKeyNull, isLeftOuterJoin, setFragment, setReplFiles, supportsMultipleInputs, supportsMultipleOutputs, visit

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

addOriginalLocation, addOriginalLocation, attachInput, cloneHelper, clonePlans, copyAliasFrom, detachInput, getAlias, getAliasString, getIllustrator, getInputs, getLogger, getNext, getNextBigDecimal, getNextBigInteger, getNextBoolean, getNextDataBag, getNextDataByteArray, getNextDateTime, getNextDouble, getNextFloat, getNextInteger, getNextLong, getNextMap, getNextString, getOriginalLocations, getParentPlan, getPigLogger, getReporter, getRequestedParallelism, getResultType, isAccumStarted, isAccumulative, isBlocking, isEndOfAllInput, isInputAttached, processInput, reset, setAccumEnd, setAccumStart, setAccumulative, setIllustrator, setInputs, setParentPlan, setPigLogger, setReporter, setRequestedParallelism, setResultType, staticDataCleanup

Methods inherited from class org.apache.pig.impl.plan.Operator

compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, toString, unsetProjectionMap

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

POFRJoinTez

public POFRJoinTez(POFRJoin copy,
                   java.util.List<java.lang.String> inputKeys)
            throws ExecException

Throws:

ExecException

Method Detail

getTezInputs

public java.lang.String[] getTezInputs()

Specified by:

getTezInputs in interface TezInput

replaceInput

public void replaceInput(java.lang.String oldInputKey,
                         java.lang.String newInputKey)

Specified by:

replaceInput in interface TezInput

addInputsToSkip

public void addInputsToSkip(java.util.Set<java.lang.String> inputsToSkip)

Description copied from interface: TezInput

Add to the list of inputs to skip download if already available in vertex cache

Specified by:

addInputsToSkip in interface TezInput

attachInputs

public void attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs,
                         org.apache.hadoop.conf.Configuration conf)
                  throws ExecException

Description copied from interface: TezInput

Attach the inputs to the operator. Also ensure reader.next() is called to force fetch the input so that all inputs are fetched and memory released before memory is allocated for outputs

Specified by:

attachInputs in interface TezInput

Parameters:

inputs - available inputs

conf - configuration

Throws:

ExecException

setUpHashMap

protected void setUpHashMap()
                     throws ExecException

Builds the HashMaps by reading replicated inputs from broadcast edges

Overrides:

setUpHashMap in class POFRJoin

Throws:

ExecException

name

public java.lang.String name()

Overrides:

name in class POFRJoin

getInputKeys

public java.util.List<java.lang.String> getInputKeys()

clone

public POFRJoinTez clone()
                  throws java.lang.CloneNotSupportedException

Description copied from class: PhysicalOperator

Make a copy of this operator. This function is blank, however, we should leave a place holder so that the subclasses can clone to make deep copy as this one creates a shallow copy of non-primitive types (objects, arrays and lists)

Overrides:

clone in class POFRJoin

Throws:

java.lang.CloneNotSupportedException

See Also:

Do not use the clone method directly. Operators are cloned when logical plans are cloned using {@link LogicalPlanCloner}