org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators

Class POProject

java.lang.Object

org.apache.pig.impl.plan.Operator<PhyPlanVisitor>

org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.ExpressionOperator

org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.lang.Comparable<Operator>, Illustrable

Direct Known Subclasses:

PORelationToExprProject

public class POProject
extends ExpressionOperator

Implements the overloaded form of the project operator. Projects the specified column from the input tuple. However, if asked for tuples when the input is a bag, the overloaded form is invoked and the project streams the tuples through instead of the bag.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

PhysicalOperator.OriginalLocation

Field Summary

Fields

Modifier and Type	Field and Description
protected static BagFactory	bagFactory
protected java.util.ArrayList<java.lang.Integer>	columns

Fields inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

alias, illustrator, input, inputAttached, inputs, lineageTracer, outputs, parentPlan, pigLogger, reporter, requestedParallelism, res, RESULT_EMPTY, RESULT_EOP, resultType

Fields inherited from class org.apache.pig.impl.plan.Operator

mKey

Constructor Summary

Constructors

Constructor and Description
POProject(OperatorKey k)
POProject(OperatorKey k, int rp)
POProject(OperatorKey k, int rp, java.util.ArrayList<java.lang.Integer> cols)
POProject(OperatorKey k, int rp, int col)

Method Summary

Methods

Modifier and Type	Method and Description
void	attachInput(Tuple t) Overridden since the attachment of the new input should cause the old processing to end.
POProject	clone() Make a deep copy of this operator.
protected Result	consumeInputBag(Result input)
java.util.List<ExpressionOperator>	getChildExpressions() Get the sub-expressions of this expression.
int	getColumn()
java.util.ArrayList<java.lang.Integer>	getColumns()
Result	getNext() Fetches the input tuple and returns the requested column
Result	getNextBigDecimal()
Result	getNextBigInteger()
Result	getNextBoolean()
Result	getNextDataBag()
Result	getNextDataByteArray()
Result	getNextDateTime()
Result	getNextDouble()
Result	getNextFloat()
Result	getNextInteger()
Result	getNextLong()
Result	getNextMap()
Result	getNextString()
Result	getNextTuple() Asked for Tuples.
int	getStartCol()
Tuple	illustratorMarkup(java.lang.Object in, java.lang.Object out, int eqClassIndex) input tuple mark up to be illustrate-able
boolean	isOverloaded()
boolean	isProjectToEnd()
boolean	isStar()
java.lang.String	name()
protected Result	processInputBag()
void	setColumn(int col)
void	setColumns(java.util.ArrayList<java.lang.Integer> cols)
void	setOverloaded(boolean overloaded)
void	setProjectToEnd(int startCol)
void	setResultSingleTupleBag(boolean resultSingleTupleBag)
void	setStar(boolean star)
boolean	supportsMultipleInputs() Indicates whether this operator supports multiple inputs.
boolean	supportsMultipleOutputs() Indicates whether this operator supports multiple outputs.
void	visit(PhyPlanVisitor v) Visit this node with the provided visitor.

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.ExpressionOperator

accumChild, containUDF, setIllustrator, toString

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator

addOriginalLocation, addOriginalLocation, cloneHelper, copyAliasFrom, detachInput, getAlias, getAliasString, getIllustrator, getInputs, getLogger, getNext, getOriginalLocations, getPigLogger, getReporter, getRequestedParallelism, getResultType, isAccumStarted, isAccumulative, isBlocking, isInputAttached, processInput, reset, setAccumEnd, setAccumStart, setAccumulative, setInputs, setParentPlan, setPigLogger, setReporter, setRequestedParallelism, setResultType, staticDataCleanup

Methods inherited from class org.apache.pig.impl.plan.Operator

compareTo, equals, getOperatorKey, getProjectionMap, hashCode, regenerateProjectionMap, rewire, unsetProjectionMap

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Field Detail

bagFactory

protected static final BagFactory bagFactory

columns

protected java.util.ArrayList<java.lang.Integer> columns

Constructor Detail

POProject

public POProject(OperatorKey k)

POProject

public POProject(OperatorKey k,
         int rp)

POProject

public POProject(OperatorKey k,
         int rp,
         int col)

POProject

public POProject(OperatorKey k,
         int rp,
         java.util.ArrayList<java.lang.Integer> cols)

Method Detail

setProjectToEnd

public void setProjectToEnd(int startCol)

name

public java.lang.String name()

Specified by:

name in class Operator<PhyPlanVisitor>

supportsMultipleInputs

public boolean supportsMultipleInputs()

Description copied from class: Operator

Indicates whether this operator supports multiple inputs.

Specified by:

supportsMultipleInputs in class Operator<PhyPlanVisitor>

Returns:

true if it does, otherwise false.

supportsMultipleOutputs

public boolean supportsMultipleOutputs()

Description copied from class: Operator

Indicates whether this operator supports multiple outputs.

Overrides:

supportsMultipleOutputs in class ExpressionOperator

Returns:

true if it does, otherwise false.

visit

public void visit(PhyPlanVisitor v)
           throws VisitorException

Description copied from class: Operator

Visit this node with the provided visitor. This should only be called by the visitor class itself, never directly.

Specified by:

visit in class ExpressionOperator

Parameters:

v - Visitor to visit with.

Throws:

VisitorException - if the visitor has a problem.

attachInput

public void attachInput(Tuple t)

Overridden since the attachment of the new input should cause the old processing to end.

Overrides:

attachInput in class PhysicalOperator

Parameters:

t - - The tuple that should be used as input

getNext

public Result getNext()
               throws ExecException

Fetches the input tuple and returns the requested column

Returns:

next value.

Throws:

ExecException

getNextDataBag

public Result getNextDataBag()
                      throws ExecException

Overrides:

getNextDataBag in class ExpressionOperator

Throws:

ExecException

consumeInputBag

protected Result consumeInputBag(Result input)
                          throws ExecException

Parameters:

input -

Throws:

ExecException

getNextDataByteArray

public Result getNextDataByteArray()
                            throws ExecException

Overrides:

getNextDataByteArray in class PhysicalOperator

Throws:

ExecException

getNextDouble

public Result getNextDouble()
                     throws ExecException

Overrides:

getNextDouble in class PhysicalOperator

Throws:

ExecException

getNextFloat

public Result getNextFloat()
                    throws ExecException

Overrides:

getNextFloat in class PhysicalOperator

Throws:

ExecException

getNextInteger

public Result getNextInteger()
                      throws ExecException

Overrides:

getNextInteger in class PhysicalOperator

Throws:

ExecException

getNextLong

public Result getNextLong()
                   throws ExecException

Overrides:

getNextLong in class PhysicalOperator

Throws:

ExecException

getNextBoolean

public Result getNextBoolean()
                      throws ExecException

Overrides:

getNextBoolean in class PhysicalOperator

Throws:

ExecException

getNextDateTime

public Result getNextDateTime()
                       throws ExecException

Overrides:

getNextDateTime in class PhysicalOperator

Throws:

ExecException

getNextMap

public Result getNextMap()
                  throws ExecException

Overrides:

getNextMap in class PhysicalOperator

Throws:

ExecException

getNextString

public Result getNextString()
                     throws ExecException

Overrides:

getNextString in class PhysicalOperator

Throws:

ExecException

getNextBigInteger

public Result getNextBigInteger()
                         throws ExecException

Overrides:

getNextBigInteger in class PhysicalOperator

Throws:

ExecException

getNextBigDecimal

public Result getNextBigDecimal()
                         throws ExecException

Overrides:

getNextBigDecimal in class PhysicalOperator

Throws:

ExecException

getNextTuple

public Result getNextTuple()
                    throws ExecException

Asked for Tuples. Check if the input is a bag. If so, stream the tuples in the bag instead of the entire bag.

Overrides:

getNextTuple in class PhysicalOperator

Throws:

ExecException

getColumns

public java.util.ArrayList<java.lang.Integer> getColumns()

getColumn

public int getColumn()
              throws ExecException

Throws:

ExecException

getStartCol

public int getStartCol()

setColumns

public void setColumns(java.util.ArrayList<java.lang.Integer> cols)

setColumn

public void setColumn(int col)

isOverloaded

public boolean isOverloaded()

setOverloaded

public void setOverloaded(boolean overloaded)

isStar

public boolean isStar()

isProjectToEnd

public boolean isProjectToEnd()

setStar

public void setStar(boolean star)

clone

public POProject clone()
                throws java.lang.CloneNotSupportedException

Description copied from class: ExpressionOperator

Make a deep copy of this operator. This is declared here to make it possible to call clone on ExpressionOperators.

Overrides:

clone in class ExpressionOperator

Throws:

java.lang.CloneNotSupportedException

See Also:

Do not use the clone method directly. Operators are cloned when logical plans are cloned using {@link LogicalPlanCloner}

processInputBag

protected Result processInputBag()
                          throws ExecException

Throws:

ExecException

setResultSingleTupleBag

public void setResultSingleTupleBag(boolean resultSingleTupleBag)

getChildExpressions

public java.util.List<ExpressionOperator> getChildExpressions()

Description copied from class: ExpressionOperator

Get the sub-expressions of this expression. This is called if reducer is run as accumulative mode, all the child expression must be called if they have any UDF to drive the UDF.accumulate()

Specified by:

getChildExpressions in class ExpressionOperator

illustratorMarkup

public Tuple illustratorMarkup(java.lang.Object in,
                      java.lang.Object out,
                      int eqClassIndex)

Description copied from interface: Illustrable

input tuple mark up to be illustrate-able

Parameters:

in - input tuple

out - output tuple before wrapped in ExampleTuple

eqClassIndex - index into equivalence classes in illustrator

Returns:

tuple