org.apache.pig.backend.hadoop.executionengine.tez.plan.operator

Class POBloomFilterRearrangeTez

java.lang.Object

org.apache.pig.impl.plan.Operator<PhyPlanVisitor>

org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange

org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POLocalRearrangeTez

org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POBloomFilterRearrangeTez

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.lang.Comparable<Operator>, TezInput, TezOutput, Illustrable

@InterfaceAudience.Private
 @InterfaceStability.Evolving
public class POBloomFilterRearrangeTez
extends POLocalRearrangeTez
implements TezInput

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

PhysicalOperator.OriginalLocation

Field Summary

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POLocalRearrangeTez

connectedToPackage, isSkewedJoin, outputKey, writer

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange

index, inp, isCross, keyType, leafOps, mainKeyType, mFakeTuple, mIsDistinct, plans, secondaryKeyType, secondaryLeafOps, secondaryPlans

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

alias, illustrator, input, inputAttached, inputs, lineageTracer, mBagFactory, mTupleFactory, outputs, parentPlan, pigLogger, reporter, requestedParallelism, res, RESULT_EMPTY, RESULT_EOP, resultType

Fields inherited from class org.apache.pig.impl.plan.Operator

mKey

Constructor Summary

Constructors

Constructor and Description
POBloomFilterRearrangeTez(POLocalRearrangeTez lr, int numBloomFilters)

Method Summary

Modifier and Type	Method and Description
void	addInputsToSkip(java.util.Set<java.lang.String> inputsToSkip) Add to the list of inputs to skip download if already available in vertex cache
void	attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs, org.apache.hadoop.conf.Configuration conf) Attach the inputs to the operator.
POBloomFilterRearrangeTez	clone() Make a deep copy of this operator.
Result	getNextTuple() Calls getNext on the generate operator inside the nested physical plan.
java.lang.String[]	getTezInputs()
java.lang.String	name()
void	replaceInput(java.lang.String oldInputKey, java.lang.String newInputKey)
void	setInputKey(java.lang.String inputKey)

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.tez.plan.operator.POLocalRearrangeTez

attachOutputs, containsOutputKey, getRearrangedTuple, getTezOutputs, isConnectedToPackage, isSkewedJoin, replaceOutput, setConnectedToPackage, setOutputKey, setSkewedJoin

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange

attachInput, constructLROutput, getIndex, getKeyFromResult, getKeyType, getMainKeyType, getPlans, getProjectedColsMap, getSecondaryProjectedColsMap, illustratorMarkup, isCross, isDistinct, isKeyCompound, isKeyTuple, isProjectStar, isSecondaryKeyTuple, isSecondaryProjectStar, setCross, setDistinct, setIndex, setKeyType, setMultiQueryIndex, setPlans, setPlansFromCombiner, setSecondaryPlans, setStripKeyFromValue, setUseSecondaryKey, supportsMultipleInputs, supportsMultipleOutputs, visit

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

addOriginalLocation, addOriginalLocation, cloneHelper, clonePlans, copyAliasFrom, detachInput, getAlias, getAliasString, getIllustrator, getInputs, getLogger, getNext, getNextBigDecimal, getNextBigInteger, getNextBoolean, getNextDataBag, getNextDataByteArray, getNextDateTime, getNextDouble, getNextFloat, getNextInteger, getNextLong, getNextMap, getNextString, getOriginalLocations, getParentPlan, getPigLogger, getReporter, getRequestedParallelism, getResultType, isAccumStarted, isAccumulative, isBlocking, isEndOfAllInput, isInputAttached, processInput, reset, setAccumEnd, setAccumStart, setAccumulative, setIllustrator, setInputs, setParentPlan, setPigLogger, setReporter, setRequestedParallelism, setResultType, staticDataCleanup

Methods inherited from class org.apache.pig.impl.plan.Operator

compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, toString, unsetProjectionMap

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

POBloomFilterRearrangeTez

public POBloomFilterRearrangeTez(POLocalRearrangeTez lr,
                                 int numBloomFilters)

Method Detail

setInputKey

public void setInputKey(java.lang.String inputKey)

getTezInputs

public java.lang.String[] getTezInputs()

Specified by:

getTezInputs in interface TezInput

replaceInput

public void replaceInput(java.lang.String oldInputKey,
                         java.lang.String newInputKey)

Specified by:

replaceInput in interface TezInput

addInputsToSkip

public void addInputsToSkip(java.util.Set<java.lang.String> inputsToSkip)

Description copied from interface: TezInput

Add to the list of inputs to skip download if already available in vertex cache

Specified by:

addInputsToSkip in interface TezInput

attachInputs

public void attachInputs(java.util.Map<java.lang.String,org.apache.tez.runtime.api.LogicalInput> inputs,
                         org.apache.hadoop.conf.Configuration conf)
                  throws ExecException

Description copied from interface: TezInput

Attach the inputs to the operator. Also ensure reader.next() is called to force fetch the input so that all inputs are fetched and memory released before memory is allocated for outputs

Specified by:

attachInputs in interface TezInput

Parameters:

inputs - available inputs

conf - configuration

Throws:

ExecException

getNextTuple

public Result getNextTuple()
                    throws ExecException

Description copied from class: POLocalRearrange

Calls getNext on the generate operator inside the nested physical plan. Converts the generated tuple into the proper format, i.e, (key,indexedTuple(value))

Overrides:

getNextTuple in class POLocalRearrangeTez

Throws:

ExecException

clone

public POBloomFilterRearrangeTez clone()
                                throws java.lang.CloneNotSupportedException

Description copied from class: POLocalRearrange

Make a deep copy of this operator.

Overrides:

clone in class POLocalRearrangeTez

Throws:

java.lang.CloneNotSupportedException

See Also:

Do not use the clone method directly. Operators are cloned when logical plans are cloned using {@link LogicalPlanCloner}

name

public java.lang.String name()

Overrides:

name in class POLocalRearrangeTez