org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators

Class POPoissonSample

java.lang.Object

org.apache.pig.impl.plan.Operator<PhyPlanVisitor>

org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPoissonSample

All Implemented Interfaces:

Serializable, Cloneable, Comparable<Operator>, Illustrable

Direct Known Subclasses:

POPoissonSampleSpark

public class POPoissonSample
extends PhysicalOperator

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

PhysicalOperator.OriginalLocation

Field Summary

Fields

Modifier and Type	Field and Description
protected long	avgTupleMemSz
static int	DEFAULT_SAMPLE_RATE
protected float	heapPerc
protected boolean	initialized
protected long	memToSkipPerSample
protected Result	newSample
protected boolean	numRowSplTupleReturned
protected int	numRowsSampled
protected int	numSkipped
protected long	rowNum
protected int	sampleRate
protected static long	serialVersionUID
protected long	skipInterval
protected Long	totalMemory

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

alias, illustrator, input, inputAttached, inputs, lineageTracer, mBagFactory, mTupleFactory, outputs, parentPlan, pigLogger, reporter, requestedParallelism, res, RESULT_EMPTY, RESULT_EOP, resultType

Fields inherited from class org.apache.pig.impl.plan.Operator

mKey

Constructor Summary

Constructors

Constructor and Description
POPoissonSample(OperatorKey k, int rp, int sr, float hp, long tm)

Method Summary

Modifier and Type	Method and Description
protected Result	createNumRowTuple(Tuple sample)
Result	getNextTuple()
Tuple	illustratorMarkup(Object in, Object out, int eqClassIndex) input tuple mark up to be illustrate-able
String	name()
boolean	supportsMultipleInputs() Indicates whether this operator supports multiple inputs.
boolean	supportsMultipleOutputs() Indicates whether this operator supports multiple outputs.
protected void	updateSkipInterval(Tuple t) Update the average tuple size base on newly sampled tuple t and recalculate skipInterval
void	visit(PhyPlanVisitor v) Visit this node with the provided visitor.

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

addOriginalLocation, addOriginalLocation, attachInput, clone, cloneHelper, clonePlans, copyAliasFrom, detachInput, getAlias, getAliasString, getIllustrator, getInputs, getLogger, getNext, getNextBigDecimal, getNextBigInteger, getNextBoolean, getNextDataBag, getNextDataByteArray, getNextDateTime, getNextDouble, getNextFloat, getNextInteger, getNextLong, getNextMap, getNextString, getOriginalLocations, getParentPlan, getPigLogger, getReporter, getRequestedParallelism, getResultType, isAccumStarted, isAccumulative, isBlocking, isEndOfAllInput, isInputAttached, processInput, reset, setAccumEnd, setAccumStart, setAccumulative, setIllustrator, setInputs, setParentPlan, setPigLogger, setReporter, setRequestedParallelism, setResultType, staticDataCleanup

Methods inherited from class org.apache.pig.impl.plan.Operator

compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, toString, unsetProjectionMap

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

serialVersionUID

protected static final long serialVersionUID

See Also:

Constant Field Values

DEFAULT_SAMPLE_RATE

public static final int DEFAULT_SAMPLE_RATE

See Also:

Constant Field Values

sampleRate

protected int sampleRate

heapPerc

protected float heapPerc

totalMemory

protected Long totalMemory

initialized

protected transient boolean initialized

numSkipped

protected transient int numSkipped

numRowsSampled

protected transient int numRowsSampled

avgTupleMemSz

protected transient long avgTupleMemSz

rowNum

protected transient long rowNum

skipInterval

protected transient long skipInterval

memToSkipPerSample

protected transient long memToSkipPerSample

numRowSplTupleReturned

protected transient boolean numRowSplTupleReturned

newSample

protected transient Result newSample

Constructor Detail

POPoissonSample

public POPoissonSample(OperatorKey k,
                       int rp,
                       int sr,
                       float hp,
                       long tm)

Method Detail

illustratorMarkup

public Tuple illustratorMarkup(Object in,
                               Object out,
                               int eqClassIndex)

Description copied from interface: Illustrable

input tuple mark up to be illustrate-able

Parameters:

in - input tuple

out - output tuple before wrapped in ExampleTuple

eqClassIndex - index into equivalence classes in illustrator

Returns:

tuple

visit

public void visit(PhyPlanVisitor v)
           throws VisitorException

Description copied from class: Operator

Visit this node with the provided visitor. This should only be called by the visitor class itself, never directly.

Specified by:

visit in class PhysicalOperator

Parameters:

v - Visitor to visit with.

Throws:

VisitorException - if the visitor has a problem.

getNextTuple

public Result getNextTuple()
                    throws ExecException

Overrides:

getNextTuple in class PhysicalOperator

Throws:

ExecException

supportsMultipleInputs

public boolean supportsMultipleInputs()

Description copied from class: Operator

Indicates whether this operator supports multiple inputs.

Specified by:

supportsMultipleInputs in class Operator<PhyPlanVisitor>

Returns:

true if it does, otherwise false.

supportsMultipleOutputs

public boolean supportsMultipleOutputs()

Description copied from class: Operator

Indicates whether this operator supports multiple outputs.

Specified by:

supportsMultipleOutputs in class Operator<PhyPlanVisitor>

Returns:

true if it does, otherwise false.

name

public String name()

Specified by:

name in class Operator<PhyPlanVisitor>

updateSkipInterval

protected void updateSkipInterval(Tuple t)

Update the average tuple size base on newly sampled tuple t and recalculate skipInterval

Parameters:

t - - tuple

createNumRowTuple

protected Result createNumRowTuple(Tuple sample)
                            throws ExecException

Parameters:

sample - - sample tuple

Returns:

- Tuple appended with special marker string column, num-rows column

Throws:

ExecException