Package | Description |
---|---|
org.apache.pig.backend.hadoop.executionengine.physicalLayer |
Implementation of physical operators that use hadoop as the execution engine
and data storage.
|
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators | |
org.apache.pig.backend.hadoop.executionengine.spark.operator | |
org.apache.pig.backend.hadoop.executionengine.tez.plan.operator |
Modifier and Type | Class and Description |
---|---|
class |
PhysicalOperator
This is the base class for all operators.
|
Modifier and Type | Class and Description |
---|---|
class |
Add |
class |
BinaryComparisonOperator
This is a base class for all binary comparison operators.
|
class |
BinaryExpressionOperator
A base class for all Binary expression operators.
|
class |
ConstantExpression
This class implements a Constant of any type.
|
class |
Divide |
class |
EqualToExpr |
class |
ExpressionOperator
A base class for all types of expressions.
|
class |
GreaterThanExpr |
class |
GTOrEqualToExpr |
class |
LessThanExpr |
class |
LTOrEqualToExpr |
class |
Mod |
class |
Multiply |
class |
NotEqualToExpr |
class |
POAnd
Boolean and operator.
|
class |
POBinCond |
class |
POCast
This is just a cast that converts DataByteArray into either String or
Integer.
|
class |
POIsNull |
class |
POMapLookUp |
class |
PONegative |
class |
PONot
Boolean not operator.
|
class |
POOr
Boolean or operator.
|
class |
POProject
Implements the overloaded form of the project operator.
|
class |
PORegexp |
class |
PORelationToExprProject
Implements a specialized form of POProject which is
used *ONLY* in the following case:
This project is Project(*) introduced after a relational operator
to supply a bag as output (as an expression).
|
class |
POUserComparisonFunc |
class |
POUserFunc |
class |
Subtract |
class |
UnaryComparisonOperator
This is a base class for all unary comparison operators.
|
class |
UnaryExpressionOperator |
Modifier and Type | Class and Description |
---|---|
class |
CombinerPackager
The package operator that packages the globally rearranged tuples into
output format after the combiner stage.
|
class |
JoinPackager |
class |
LitePackager
This package operator is a specialization
of POPackage operator used for the specific
case of the order by query.
|
class |
MultiQueryPackager
The package operator that packages the globally rearranged tuples
into output format as required by multi-query de-multiplexer.
|
class |
Packager |
class |
POBroadcastSpark |
class |
POCollectedGroup
The collected group operator is a special operator used when users give
the hint 'using "collected"' in a group by clause.
|
class |
POCounter
This operator is part of the RANK operator implementation.
|
class |
POCross
Recover this class for nested cross operation.
|
class |
PODemux
The MapReduce Demultiplexer operator.
|
class |
PODistinct
Find the distinct set of tuples in a bag.
|
class |
POFilter
This is an implementation of the Filter operator.
|
class |
POForEach |
class |
POFRJoin
The operator models the join keys using the Local Rearrange operators which
are configured with the plan specified by the user.
|
class |
POFRJoinSpark |
class |
POGlobalRearrange
Dummy operator to test MRCompiler.
|
class |
POLimit |
class |
POLoad
The load operator which is used in two ways:
1) As a local operator it can be used to load files
2) In the Map Reduce setting, it is used to create jobs
from MapReduce operators which keep the loads and
stores in the Map and Reduce Plans till the job is created
|
class |
POLocalRearrange
The local rearrange operator is a part of the co-group
implementation.
|
class |
POMergeCogroup |
class |
POMergeJoin
This operator implements merge join algorithm to do map side joins.
|
class |
PONative |
class |
POOptimizedForEach
A specialized version of POForeach with the difference
that in getNext(), it knows that "input" has already been
attached by its input operator which SHOULD be POJoinPackage
|
class |
POPackage
The package operator that packages
the globally rearranged tuples into
output format as required by co-group.
|
class |
POPartialAgg
Do partial aggregation in map plan.
|
class |
POPartitionRearrange
The partition rearrange operator is a part of the skewed join
implementation.
|
class |
POPoissonSample |
class |
POPreCombinerLocalRearrange
A specialized local rearrange operator which behaves
like the regular local rearrange in the getNext()
as far as getting its input and constructing the
"key" out of the input.
|
class |
PORank
This operator is part of the RANK operator implementation.
|
class |
POReservoirSample |
class |
POSkewedJoin
The PhysicalOperator that represents a skewed join.
|
class |
POSort
This implementation is applicable for both the physical plan and for the
local backend, as the conversion of physical to mapreduce would see the SORT
operator and take necessary steps to convert it to a quantile and a sort job.
|
class |
POSortedDistinct
This operator is a variation of PODistinct, the input to this operator
must be sorted already.
|
class |
POSplit
The MapReduce Split operator.
|
class |
POStore
The store operator which is used in two ways:
1) As a local operator it can be used to store files
2) In the Map Reduce setting, it is used to create jobs
from MapReduce operators which keep the loads and
stores in the Map and Reduce Plans till the job is created
|
class |
POStream |
class |
POUnion
The union operator that combines the two inputs into a single
stream.
|
Modifier and Type | Class and Description |
---|---|
class |
POGlobalRearrangeSpark
POGlobalRearrange for spark mode
|
class |
POJoinGroupSpark
Collapse POLocalRearrange,POGlobalRearrange and POPackage to POJoinGroupSpark to reduce unnecessary map operations in the join/group
|
class |
POPoissonSampleSpark |
class |
POReduceBySpark
ReduceBy operator that maps to Sparks ReduceBy.
|
class |
POSampleSortSpark |
Modifier and Type | Class and Description |
---|---|
class |
BloomPackager |
class |
POBloomFilterRearrangeTez |
class |
POBuildBloomRearrangeTez
This operator writes out the key value for the hash join reduce operation similar to POLocalRearrangeTez.
|
class |
POCounterStatsTez
POCounterStatsTez is used to group counters from previous vertex POCounterTez tasks
|
class |
POCounterTez |
class |
POFRJoinTez
POFRJoinTez is used on the backend to load replicated table from Tez
ShuffleUnorderedKVInput and load fragmented table from data pipeline.
|
class |
POIdentityInOutTez
POIdentityInOutTez is used to pass through tuples as is to next vertex from
previous vertex's POLocalRearrangeTez.
|
class |
POLocalRearrangeTez
POLocalRearrangeTez is used to write to a Tez OrderedPartitionedKVOutput
(shuffle) or UnorderedKVOutput (broadcast)
|
class |
POPartitionRearrangeTez
The partition rearrange operator is a part of the skewed join implementation.
|
class |
PORankTez |
class |
POShuffledValueInputTez
POShuffledValueInputTez is used read tuples from a Tez Intermediate output from a shuffle edge
To be used with POValueOutputTez.
|
class |
POShuffleTezLoad |
class |
POSimpleTezLoad
POSimpleTezLoad is used on the backend to read tuples from a Tez MRInput
|
class |
POStoreTez
POStoreTez is used to write to a Tez MROutput
|
class |
POValueInputTez
POValueInputTez is used read tuples from a Tez Intermediate output from a 1-1
edge
|
class |
POValueOutputTez |
Copyright © 2007-2017 The Apache Software Foundation