org.apache.pig.backend.hadoop.executionengine.tez.plan.operator

Class POSimpleTezLoad

java.lang.Object

org.apache.pig.impl.plan.Operator<PhyPlanVisitor>

org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLoad

org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POSimpleTezLoad

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.lang.Comparable<Operator>, TezInput, Illustrable

public class POSimpleTezLoad
extends POLoad
implements TezInput

POSimpleTezLoad is used on the backend to read tuples from a Tez MRInput

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

PhysicalOperator.OriginalLocation

Field Summary

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

alias, illustrator, inputAttached, inputs, lineageTracer, outputs, parentPlan, pigLogger, reporter, requestedParallelism, res, RESULT_EMPTY, RESULT_EOP, resultType

Fields inherited from class org.apache.pig.impl.plan.Operator

mKey

Constructor Summary

Constructors

Constructor and Description
POSimpleTezLoad(OperatorKey k, FileSpec lfile)

Method Summary

Methods

Modifier and Type	Method and Description
void	addInputsToSkip(java.util.Set<java.lang.String> inputsToSkip) Add to the list of inputs to skip download if already available in vertex cache
void	attachInputs(java.util.Map<java.lang.String,LogicalInput> inputs, org.apache.hadoop.conf.Configuration conf)
Result	getNextTuple() Previously, we reused the same Result object for all results, but we found certain operators (e.g.
java.lang.String[]	getTezInputs()
void	replaceInput(java.lang.String oldInputKey, java.lang.String newInputKey)
void	setInputKey(java.lang.String inputKey)

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLoad

getCacheFiles, getLFile, getLimit, getLoadFunc, getPc, getShipFiles, getSignature, illustratorMarkup, isTmpLoad, name, setCacheFiles, setIsTmpLoad, setLFile, setLimit, setPc, setShipFiles, setSignature, setUp, supportsMultipleInputs, supportsMultipleOutputs, tearDown, visit

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

addOriginalLocation, addOriginalLocation, attachInput, clone, cloneHelper, copyAliasFrom, detachInput, getAlias, getAliasString, getIllustrator, getInputs, getLogger, getNext, getNextBigDecimal, getNextBigInteger, getNextBoolean, getNextDataBag, getNextDataByteArray, getNextDateTime, getNextDouble, getNextFloat, getNextInteger, getNextLong, getNextMap, getNextString, getOriginalLocations, getPigLogger, getReporter, getRequestedParallelism, getResultType, isAccumStarted, isAccumulative, isBlocking, isInputAttached, processInput, reset, setAccumEnd, setAccumStart, setAccumulative, setIllustrator, setInputs, setParentPlan, setPigLogger, setReporter, setRequestedParallelism, setResultType, staticDataCleanup

Methods inherited from class org.apache.pig.impl.plan.Operator

compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, toString, unsetProjectionMap

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

POSimpleTezLoad

public POSimpleTezLoad(OperatorKey k,
               FileSpec lfile)

Method Detail

getTezInputs

public java.lang.String[] getTezInputs()

Specified by:

getTezInputs in interface TezInput

replaceInput

public void replaceInput(java.lang.String oldInputKey,
                java.lang.String newInputKey)

Specified by:

replaceInput in interface TezInput

addInputsToSkip

public void addInputsToSkip(java.util.Set<java.lang.String> inputsToSkip)

Description copied from interface: TezInput

Add to the list of inputs to skip download if already available in vertex cache

Specified by:

addInputsToSkip in interface TezInput

attachInputs

public void attachInputs(java.util.Map<java.lang.String,LogicalInput> inputs,
                org.apache.hadoop.conf.Configuration conf)
                  throws ExecException

Specified by:

attachInputs in interface TezInput

Throws:

ExecException

getNextTuple

public Result getNextTuple()
                    throws ExecException

Previously, we reused the same Result object for all results, but we found certain operators (e.g. POStream) save references to the Result object and expect it to be constant.

Overrides:

getNextTuple in class POLoad

Returns:

Whatever the loader returns A null from the loader is indicative of EOP and hence the tearDown of connection

Throws:

ExecException

setInputKey

public void setInputKey(java.lang.String inputKey)