org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators

Class POStream

java.lang.Object

org.apache.pig.impl.plan.Operator<PhyPlanVisitor>

org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POStream

All Implemented Interfaces:

Serializable, Cloneable, Comparable<Operator>, Illustrable

public class POStream
extends PhysicalOperator

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

PhysicalOperator.OriginalLocation

Field Summary

Fields

Modifier and Type	Field and Description
protected boolean	allInputFromPredecessorConsumed
protected boolean	allOutputFromBinaryProcessed
protected BlockingQueue<Result>	binaryInputQueue
protected BlockingQueue<Result>	binaryOutputQueue

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

alias, illustrator, input, inputAttached, inputs, lineageTracer, mBagFactory, mTupleFactory, outputs, parentPlan, pigLogger, reporter, requestedParallelism, res, RESULT_EMPTY, RESULT_EOP, resultType

Fields inherited from class org.apache.pig.impl.plan.Operator

mKey

Constructor Summary

Constructors

Constructor and Description
POStream(OperatorKey k, ExecutableManager executableManager, StreamingCommand command, Properties properties)

Method Summary

Methods

Modifier and Type	Method and Description
PhysicalOperator	clone() Make a copy of this operator.
void	finish()
BlockingQueue<Result>	getBinaryInputQueue()
BlockingQueue<Result>	getBinaryOutputQueue()
StreamingCommand	getCommand() Get the StreamingCommand for this StreamSpec.
boolean	getInitialized()
Result	getNextHelper(Tuple t)
Result	getNextTuple()
Properties	getShipCacheProperties()
Tuple	illustratorMarkup(Object in, Object out, int eqClassIndex) input tuple mark up to be illustrate-able
boolean	isFetchable()
String	name()
void	setFetchable(boolean isFetchable)
void	setInitialized(boolean initialized)
boolean	supportsMultipleInputs() Indicates whether this operator supports multiple inputs.
boolean	supportsMultipleOutputs() Indicates whether this operator supports multiple outputs.
String	toString()
void	visit(PhyPlanVisitor v) Visit this node with the provided visitor.

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

addOriginalLocation, addOriginalLocation, attachInput, cloneHelper, clonePlans, copyAliasFrom, detachInput, getAlias, getAliasString, getIllustrator, getInputs, getLogger, getNext, getNextBigDecimal, getNextBigInteger, getNextBoolean, getNextDataBag, getNextDataByteArray, getNextDateTime, getNextDouble, getNextFloat, getNextInteger, getNextLong, getNextMap, getNextString, getOriginalLocations, getPigLogger, getReporter, getRequestedParallelism, getResultType, isAccumStarted, isAccumulative, isBlocking, isInputAttached, processInput, reset, setAccumEnd, setAccumStart, setAccumulative, setIllustrator, setInputs, setParentPlan, setPigLogger, setReporter, setRequestedParallelism, setResultType, staticDataCleanup

Methods inherited from class org.apache.pig.impl.plan.Operator

compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, unsetProjectionMap

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

binaryOutputQueue

protected BlockingQueue<Result> binaryOutputQueue

binaryInputQueue

protected BlockingQueue<Result> binaryInputQueue

allInputFromPredecessorConsumed

protected transient boolean allInputFromPredecessorConsumed

allOutputFromBinaryProcessed

protected transient boolean allOutputFromBinaryProcessed

Constructor Detail

POStream

public POStream(OperatorKey k,
        ExecutableManager executableManager,
        StreamingCommand command,
        Properties properties)

Method Detail

getShipCacheProperties

public Properties getShipCacheProperties()

getCommand

public StreamingCommand getCommand()

Get the StreamingCommand for this StreamSpec.

Returns:

the StreamingCommand for this StreamSpec

getNextTuple

public Result getNextTuple()
                    throws ExecException

Overrides:

getNextTuple in class PhysicalOperator

Throws:

ExecException

getInitialized

public boolean getInitialized()

setInitialized

public void setInitialized(boolean initialized)

getNextHelper

public Result getNextHelper(Tuple t)
                     throws ExecException

Throws:

ExecException

toString

public String toString()

Overrides:

toString in class Operator<PhyPlanVisitor>

visit

public void visit(PhyPlanVisitor v)
           throws VisitorException

Description copied from class: Operator

Visit this node with the provided visitor. This should only be called by the visitor class itself, never directly.

Specified by:

visit in class PhysicalOperator

Parameters:

v - Visitor to visit with.

Throws:

VisitorException - if the visitor has a problem.

name

public String name()

Specified by:

name in class Operator<PhyPlanVisitor>

supportsMultipleInputs

public boolean supportsMultipleInputs()

Description copied from class: Operator

Indicates whether this operator supports multiple inputs.

Specified by:

supportsMultipleInputs in class Operator<PhyPlanVisitor>

Returns:

true if it does, otherwise false.

supportsMultipleOutputs

public boolean supportsMultipleOutputs()

Description copied from class: Operator

Indicates whether this operator supports multiple outputs.

Specified by:

supportsMultipleOutputs in class Operator<PhyPlanVisitor>

Returns:

true if it does, otherwise false.

finish

public void finish()
            throws IOException

Throws:

IOException

getBinaryInputQueue

public BlockingQueue<Result> getBinaryInputQueue()

Returns:

the Queue which has input to binary

getBinaryOutputQueue

public BlockingQueue<Result> getBinaryOutputQueue()

Returns:

the Queue which has output from binary

illustratorMarkup

public Tuple illustratorMarkup(Object in,
                      Object out,
                      int eqClassIndex)

Description copied from interface: Illustrable

input tuple mark up to be illustrate-able

Parameters:

in - input tuple

out - output tuple before wrapped in ExampleTuple

eqClassIndex - index into equivalence classes in illustrator

Returns:

tuple

isFetchable

public boolean isFetchable()

Returns:

true if streaming is done through fetching

setFetchable

public void setFetchable(boolean isFetchable)

Parameters:

isFetchable - - whether fetching is applied on POStream

clone

public PhysicalOperator clone()
                       throws CloneNotSupportedException

Description copied from class: PhysicalOperator

Make a copy of this operator. This function is blank, however, we should leave a place holder so that the subclasses can clone to make deep copy as this one creates a shallow copy of non-primitive types (objects, arrays and lists)

Overrides:

clone in class PhysicalOperator

Throws:

CloneNotSupportedException

See Also:

Do not use the clone method directly. Operators are cloned when logical plans are cloned using {@link LogicalPlanCloner}