org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators

Class POMergeCogroup

java.lang.Object

org.apache.pig.impl.plan.Operator<PhyPlanVisitor>

org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POMergeCogroup

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.lang.Comparable<Operator>, Illustrable

Direct Known Subclasses:

POMergeCogroupTez

public class POMergeCogroup
extends PhysicalOperator

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

PhysicalOperator.OriginalLocation

Field Summary

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

alias, illustrator, input, inputAttached, inputs, lineageTracer, mBagFactory, mTupleFactory, outputs, parentPlan, pigLogger, reporter, requestedParallelism, res, RESULT_EMPTY, RESULT_EOP, resultType

Fields inherited from class org.apache.pig.impl.plan.Operator

mKey

Constructor Summary

Constructors

Constructor and Description
POMergeCogroup(OperatorKey k, java.util.List<PhysicalOperator> inpPOs, POLocalRearrange[] lrs, int parallel)
POMergeCogroup(POMergeCogroup copy)

Method Summary

Modifier and Type	Method and Description
protected void	addTupleToIndex(Tuple tuple, java.util.List<Pair<java.lang.Integer,Tuple>> index) Separates out key tuple from given tuple and adds it to index.
POMergeCogroup	clone() Make a copy of this operator.
FuncSpec	getIdxFuncSpec()
java.lang.String	getIndexFileName()
java.util.List<PhysicalPlan>	getLRInnerPlansOf(int i)
Result	getNextTuple()
Tuple	illustratorMarkup(java.lang.Object in, java.lang.Object out, int eqClassIndex) input tuple mark up to be illustrate-able
boolean	isEndOfInput()
java.lang.String	name()
protected java.util.List<Pair<java.lang.Integer,Tuple>>	readIndex()
void	setEndOfInput(boolean isEndOfInput)
void	setEndOfRecordMark(byte endOfRecordMark)
void	setIdxFuncSpec(FuncSpec idxFileSpec)
void	setIndexFileName(java.lang.String indexFileName)
void	setLoaderSignatures(java.util.List<java.lang.String> loaderSignatures)
void	setSideFileSpecs(java.util.List<java.lang.String> sideFileSpecs)
void	setSideLoadFuncs(java.util.List<FuncSpec> sideLoadFuncs)
boolean	supportsMultipleInputs() Indicates whether this operator supports multiple inputs.
boolean	supportsMultipleOutputs() Indicates whether this operator supports multiple outputs.
void	visit(PhyPlanVisitor v) Visit this node with the provided visitor.

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

addOriginalLocation, addOriginalLocation, attachInput, cloneHelper, clonePlans, copyAliasFrom, detachInput, getAlias, getAliasString, getIllustrator, getInputs, getLogger, getNext, getNextBigDecimal, getNextBigInteger, getNextBoolean, getNextDataBag, getNextDataByteArray, getNextDateTime, getNextDouble, getNextFloat, getNextInteger, getNextLong, getNextMap, getNextString, getOriginalLocations, getParentPlan, getPigLogger, getReporter, getRequestedParallelism, getResultType, isAccumStarted, isAccumulative, isBlocking, isEndOfAllInput, isInputAttached, processInput, reset, setAccumEnd, setAccumStart, setAccumulative, setIllustrator, setInputs, setParentPlan, setPigLogger, setReporter, setRequestedParallelism, setResultType, staticDataCleanup

Methods inherited from class org.apache.pig.impl.plan.Operator

compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, toString, unsetProjectionMap

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

POMergeCogroup

public POMergeCogroup(OperatorKey k,
                      java.util.List<PhysicalOperator> inpPOs,
                      POLocalRearrange[] lrs,
                      int parallel)

POMergeCogroup

public POMergeCogroup(POMergeCogroup copy)

Method Detail

setEndOfRecordMark

public void setEndOfRecordMark(byte endOfRecordMark)

isEndOfInput

public boolean isEndOfInput()

setEndOfInput

public void setEndOfInput(boolean isEndOfInput)

getNextTuple

public Result getNextTuple()
                    throws ExecException

Overrides:

getNextTuple in class PhysicalOperator

Throws:

ExecException

readIndex

protected java.util.List<Pair<java.lang.Integer,Tuple>> readIndex()
                                                           throws ExecException

Throws:

ExecException

addTupleToIndex

protected void addTupleToIndex(Tuple tuple,
                               java.util.List<Pair<java.lang.Integer,Tuple>> index)
                        throws ExecException

Separates out key tuple from given tuple and adds it to index.

Parameters:

tuple -

index -

Throws:

ExecException

visit

public void visit(PhyPlanVisitor v)
           throws VisitorException

Description copied from class: Operator

Visit this node with the provided visitor. This should only be called by the visitor class itself, never directly.

Specified by:

visit in class PhysicalOperator

Parameters:

v - Visitor to visit with.

Throws:

VisitorException - if the visitor has a problem.

name

public java.lang.String name()

Specified by:

name in class Operator<PhyPlanVisitor>

supportsMultipleInputs

public boolean supportsMultipleInputs()

Description copied from class: Operator

Indicates whether this operator supports multiple inputs.

Specified by:

supportsMultipleInputs in class Operator<PhyPlanVisitor>

Returns:

true if it does, otherwise false.

supportsMultipleOutputs

public boolean supportsMultipleOutputs()

Description copied from class: Operator

Indicates whether this operator supports multiple outputs.

Specified by:

supportsMultipleOutputs in class Operator<PhyPlanVisitor>

Returns:

true if it does, otherwise false.

getLRInnerPlansOf

public java.util.List<PhysicalPlan> getLRInnerPlansOf(int i)

setSideLoadFuncs

public void setSideLoadFuncs(java.util.List<FuncSpec> sideLoadFuncs)

setSideFileSpecs

public void setSideFileSpecs(java.util.List<java.lang.String> sideFileSpecs)

getIndexFileName

public java.lang.String getIndexFileName()

setIndexFileName

public void setIndexFileName(java.lang.String indexFileName)

getIdxFuncSpec

public FuncSpec getIdxFuncSpec()

setIdxFuncSpec

public void setIdxFuncSpec(FuncSpec idxFileSpec)

setLoaderSignatures

public void setLoaderSignatures(java.util.List<java.lang.String> loaderSignatures)

illustratorMarkup

public Tuple illustratorMarkup(java.lang.Object in,
                               java.lang.Object out,
                               int eqClassIndex)

Description copied from interface: Illustrable

input tuple mark up to be illustrate-able

Parameters:

in - input tuple

out - output tuple before wrapped in ExampleTuple

eqClassIndex - index into equivalence classes in illustrator

Returns:

tuple

clone

public POMergeCogroup clone()
                     throws java.lang.CloneNotSupportedException

Description copied from class: PhysicalOperator

Make a copy of this operator. This function is blank, however, we should leave a place holder so that the subclasses can clone to make deep copy as this one creates a shallow copy of non-primitive types (objects, arrays and lists)

Overrides:

clone in class PhysicalOperator

Throws:

java.lang.CloneNotSupportedException

See Also:

Do not use the clone method directly. Operators are cloned when logical plans are cloned using {@link LogicalPlanCloner}