org.apache.pig.backend.hadoop.executionengine.tez.plan.operator

Class POShuffleTezLoad

java.lang.Object

org.apache.pig.impl.plan.Operator<PhyPlanVisitor>

org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage

org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POShuffleTezLoad

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.lang.Comparable<Operator>, TezInput, Illustrable

public class POShuffleTezLoad
extends POPackage
implements TezInput

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage

POPackage.POPackageTupleBuffer

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

PhysicalOperator.OriginalLocation

Field Summary

Fields

Modifier and Type	Field and Description
protected java.util.List<java.lang.String>	inputKeys
protected java.util.List<LogicalInput>	inputs
protected java.util.List<KeyValuesReader>	readers

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage

key, keyWritable, mBagFactory, mTupleFactory, numInputs, pkgr

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

alias, illustrator, input, inputAttached, lineageTracer, outputs, parentPlan, pigLogger, reporter, requestedParallelism, res, RESULT_EMPTY, RESULT_EOP, resultType

Fields inherited from class org.apache.pig.impl.plan.Operator

mKey

Constructor Summary

Constructors

Constructor and Description
POShuffleTezLoad(POPackage pack)

Method Summary

Methods

Modifier and Type	Method and Description
void	addInputKey(java.lang.String inputKey)
void	addInputsToSkip(java.util.Set<java.lang.String> inputsToSkip) Add to the list of inputs to skip download if already available in vertex cache
void	attachInputs(java.util.Map<java.lang.String,LogicalInput> inputs, org.apache.hadoop.conf.Configuration conf)
Result	getNextTuple() From the inputs, constructs the output tuple for this co-group in the required format which is (key, {bag of tuples from input 1}, {bag of tuples from input 2}, ...)
java.lang.String[]	getTezInputs()
boolean	isSkewedJoin()
void	replaceInput(java.lang.String oldInputKey, java.lang.String newInputKey)
void	setInputKeys(java.util.List<java.lang.String> inputKeys)
void	setSkewedJoins(boolean isSkewedJoin)
boolean	supportsMultipleInputs() Indicates whether this operator supports multiple inputs.

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackage

attachInput, clone, detachInput, getNumInps, getPkgr, illustratorMarkup, name, numberOfEquivalenceClasses, setIllustrator, setNumInps, setPkgr, supportsMultipleOutputs, visit

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

addOriginalLocation, addOriginalLocation, attachInput, cloneHelper, copyAliasFrom, getAlias, getAliasString, getIllustrator, getInputs, getLogger, getNext, getNextBigDecimal, getNextBigInteger, getNextBoolean, getNextDataBag, getNextDataByteArray, getNextDateTime, getNextDouble, getNextFloat, getNextInteger, getNextLong, getNextMap, getNextString, getOriginalLocations, getPigLogger, getReporter, getRequestedParallelism, getResultType, isAccumStarted, isAccumulative, isBlocking, isInputAttached, processInput, reset, setAccumEnd, setAccumStart, setAccumulative, setInputs, setParentPlan, setPigLogger, setReporter, setRequestedParallelism, setResultType, staticDataCleanup

Methods inherited from class org.apache.pig.impl.plan.Operator

compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, toString, unsetProjectionMap

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

inputKeys

protected java.util.List<java.lang.String> inputKeys

inputs

protected java.util.List<LogicalInput> inputs

readers

protected java.util.List<KeyValuesReader> readers

Constructor Detail

POShuffleTezLoad

public POShuffleTezLoad(POPackage pack)

Method Detail

getTezInputs

public java.lang.String[] getTezInputs()

Specified by:

getTezInputs in interface TezInput

replaceInput

public void replaceInput(java.lang.String oldInputKey,
                java.lang.String newInputKey)

Specified by:

replaceInput in interface TezInput

addInputsToSkip

public void addInputsToSkip(java.util.Set<java.lang.String> inputsToSkip)

Description copied from interface: TezInput

Add to the list of inputs to skip download if already available in vertex cache

Specified by:

addInputsToSkip in interface TezInput

attachInputs

public void attachInputs(java.util.Map<java.lang.String,LogicalInput> inputs,
                org.apache.hadoop.conf.Configuration conf)
                  throws ExecException

Specified by:

attachInputs in interface TezInput

Throws:

ExecException

getNextTuple

public Result getNextTuple()
                    throws ExecException

Description copied from class: POPackage

From the inputs, constructs the output tuple for this co-group in the required format which is (key, {bag of tuples from input 1}, {bag of tuples from input 2}, ...)

Overrides:

getNextTuple in class POPackage

Throws:

ExecException

setInputKeys

public void setInputKeys(java.util.List<java.lang.String> inputKeys)

addInputKey

public void addInputKey(java.lang.String inputKey)

setSkewedJoins

public void setSkewedJoins(boolean isSkewedJoin)

isSkewedJoin

public boolean isSkewedJoin()

supportsMultipleInputs

public boolean supportsMultipleInputs()

Description copied from class: Operator

Indicates whether this operator supports multiple inputs.

Overrides:

supportsMultipleInputs in class POPackage

Returns:

true if it does, otherwise false.