Package | Description |
---|---|
org.apache.pig.backend.hadoop.executionengine | |
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer |
Implementation of physical operators that use hadoop as the execution engine
and data storage.
|
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer.util | |
org.apache.pig.backend.hadoop.executionengine.tez.plan | |
org.apache.pig.backend.hadoop.executionengine.tez.plan.operator | |
org.apache.pig.data |
This package contains implementations of Pig specific data types as well as
support functions for reading, writing, and using all Pig data types.
|
org.apache.pig.impl.plan |
Modifier and Type | Field and Description |
---|---|
protected java.util.Map<OperatorKey,OperatorKey> |
HExecutionEngine.logicalToPhysicalKeys |
protected java.util.Map<OperatorKey,OperatorKey> |
HExecutionEngine.logicalToPhysicalKeys |
Modifier and Type | Method and Description |
---|---|
java.util.List<OperatorKey> |
PigSplit.getTargetOps() |
Modifier and Type | Method and Description |
---|---|
protected java.util.List<org.apache.hadoop.mapreduce.InputSplit> |
PigInputFormat.getPigSplits(java.util.List<org.apache.hadoop.mapreduce.InputSplit> oneInputSplits,
int inputIndex,
java.util.ArrayList<OperatorKey> targetOps,
long blockSize,
boolean combinable,
org.apache.hadoop.conf.Configuration conf) |
Constructor and Description |
---|
MapReduceOper(OperatorKey k) |
NativeMapReduceOper(OperatorKey k,
java.lang.String mrJar,
java.lang.String[] parameters) |
Constructor and Description |
---|
PigSplit(org.apache.hadoop.mapreduce.InputSplit[] wrappedSplits,
int inputIndex,
java.util.List<OperatorKey> targetOps,
int splitIndex) |
Constructor and Description |
---|
PhysicalOperator(OperatorKey k) |
PhysicalOperator(OperatorKey k,
int rp) |
PhysicalOperator(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp) |
PhysicalOperator(OperatorKey k,
java.util.List<PhysicalOperator> inp) |
Constructor and Description |
---|
POCollectedGroup(OperatorKey k) |
POCollectedGroup(OperatorKey k,
int rp) |
POCollectedGroup(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp) |
POCollectedGroup(OperatorKey k,
java.util.List<PhysicalOperator> inp) |
POCounter(OperatorKey k) |
POCounter(OperatorKey k,
int rp) |
POCounter(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inputs) |
POCounter(OperatorKey operatorKey,
int requestedParallelism,
java.util.List inp,
java.util.List<PhysicalPlan> counterPlans,
java.util.List<java.lang.Boolean> ascendingCol) |
POCounter(OperatorKey k,
java.util.List<PhysicalOperator> inputs) |
POCross(OperatorKey k) |
POCross(OperatorKey k,
int rp) |
POCross(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp) |
POCross(OperatorKey k,
java.util.List<PhysicalOperator> inp) |
PODemux(OperatorKey k)
Constructs an operator with the specified key.
|
PODemux(OperatorKey k,
int rp)
Constructs an operator with the specified key
and degree of parallelism.
|
PODemux(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp)
Constructs an operator with the specified key,
degree of parallelism and inputs.
|
PODemux(OperatorKey k,
java.util.List<PhysicalOperator> inp)
Constructs an operator with the specified key and inputs.
|
PODistinct(OperatorKey k) |
PODistinct(OperatorKey k,
int rp) |
PODistinct(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp) |
PODistinct(OperatorKey k,
java.util.List<PhysicalOperator> inp) |
POFilter(OperatorKey k) |
POFilter(OperatorKey k,
int rp) |
POFilter(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inputs) |
POFilter(OperatorKey k,
java.util.List<PhysicalOperator> inputs) |
POForEach(OperatorKey k) |
POForEach(OperatorKey k,
int rp) |
POForEach(OperatorKey k,
int rp,
java.util.List<PhysicalPlan> inp,
java.util.List<java.lang.Boolean> isToBeFlattened) |
POForEach(OperatorKey operatorKey,
int requestedParallelism,
java.util.List<PhysicalPlan> innerPlans,
java.util.List<java.lang.Boolean> flattenList,
Schema schema) |
POForEach(OperatorKey k,
java.util.List inp) |
POFRJoin(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp,
java.util.List<java.util.List<PhysicalPlan>> ppLists,
java.util.List<java.util.List<java.lang.Byte>> keyTypes,
FileSpec[] replFiles,
int fragment,
boolean isLeftOuter,
Tuple nullTuple) |
POFRJoin(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp,
java.util.List<java.util.List<PhysicalPlan>> ppLists,
java.util.List<java.util.List<java.lang.Byte>> keyTypes,
FileSpec[] replFiles,
int fragment,
boolean isLeftOuter,
Tuple nullTuple,
Schema[] inputSchemas,
Schema[] keySchemas) |
POGlobalRearrange(OperatorKey k) |
POGlobalRearrange(OperatorKey k,
int rp) |
POGlobalRearrange(OperatorKey k,
int rp,
java.util.List inp) |
POGlobalRearrange(OperatorKey k,
java.util.List inp) |
POLimit(OperatorKey k) |
POLimit(OperatorKey k,
int rp) |
POLimit(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inputs) |
POLimit(OperatorKey k,
java.util.List<PhysicalOperator> inputs) |
POLoad(OperatorKey k) |
POLoad(OperatorKey k,
FileSpec lFile) |
POLoad(OperatorKey k,
int rp,
FileSpec lFile) |
POLoad(OperatorKey k,
LoadFunc lf) |
POLocalRearrange(OperatorKey k) |
POLocalRearrange(OperatorKey k,
int rp) |
POLocalRearrange(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp) |
POLocalRearrange(OperatorKey k,
java.util.List<PhysicalOperator> inp) |
POMergeCogroup(OperatorKey k,
java.util.List<PhysicalOperator> inpPOs,
POLocalRearrange[] lrs,
int parallel) |
POMergeJoin(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp,
MultiMap<PhysicalOperator,PhysicalPlan> inpPlans,
java.util.List<java.util.List<java.lang.Byte>> keyTypes,
LOJoin.JOINTYPE joinType,
Schema leftInputSchema,
Schema rightInputSchema,
Schema mergedInputSchema) |
PONative(OperatorKey k) |
POOptimizedForEach(OperatorKey k) |
POOptimizedForEach(OperatorKey k,
int rp) |
POOptimizedForEach(OperatorKey k,
int rp,
java.util.List inp) |
POOptimizedForEach(OperatorKey k,
int rp,
java.util.List<PhysicalPlan> inp,
java.util.List<java.lang.Boolean> isToBeFlattened) |
POOptimizedForEach(OperatorKey k,
java.util.List inp) |
POPackage(OperatorKey k) |
POPackage(OperatorKey k,
int rp) |
POPackage(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp) |
POPackage(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp,
Packager pkgr) |
POPackage(OperatorKey k,
java.util.List<PhysicalOperator> inp) |
POPartialAgg(OperatorKey k) |
POPartitionRearrange(OperatorKey k) |
POPartitionRearrange(OperatorKey k,
int rp) |
POPartitionRearrange(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp) |
POPartitionRearrange(OperatorKey k,
java.util.List<PhysicalOperator> inp) |
POPoissonSample(OperatorKey k,
int rp,
int sr,
float hp) |
POPreCombinerLocalRearrange(OperatorKey k) |
POPreCombinerLocalRearrange(OperatorKey k,
int rp) |
POPreCombinerLocalRearrange(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp) |
POPreCombinerLocalRearrange(OperatorKey k,
java.util.List<PhysicalOperator> inp) |
PORank(OperatorKey k) |
PORank(OperatorKey k,
int rp) |
PORank(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp) |
PORank(OperatorKey operatorKey,
int requestedParallelism,
java.util.List inp,
java.util.List<PhysicalPlan> rankPlans,
java.util.List<java.lang.Boolean> ascendingCol) |
PORank(OperatorKey k,
java.util.List<PhysicalOperator> inp) |
POReservoirSample(OperatorKey k) |
POReservoirSample(OperatorKey k,
int rp) |
POReservoirSample(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp) |
POReservoirSample(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp,
int numSamples) |
POReservoirSample(OperatorKey k,
java.util.List<PhysicalOperator> inp) |
POSkewedJoin(OperatorKey k) |
POSkewedJoin(OperatorKey k,
int rp) |
POSkewedJoin(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp,
boolean[] flags) |
POSkewedJoin(OperatorKey k,
java.util.List<PhysicalOperator> inp,
boolean[] flags) |
POSort(OperatorKey k) |
POSort(OperatorKey k,
int rp) |
POSort(OperatorKey k,
int rp,
java.util.List inp) |
POSort(OperatorKey k,
int rp,
java.util.List inp,
java.util.List<PhysicalPlan> sortPlans,
java.util.List<java.lang.Boolean> mAscCols,
POUserComparisonFunc mSortFunc) |
POSort(OperatorKey k,
java.util.List inp) |
POSortedDistinct(OperatorKey k) |
POSortedDistinct(OperatorKey k,
int rp) |
POSortedDistinct(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp) |
POSortedDistinct(OperatorKey k,
java.util.List<PhysicalOperator> inp) |
POSplit(OperatorKey k)
Constructs an operator with the specified key
|
POSplit(OperatorKey k,
int rp)
Constructs an operator with the specified key
and degree of parallelism
|
POSplit(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp)
Constructs an operator with the specified key,
degree of parallelism and inputs
|
POSplit(OperatorKey k,
java.util.List<PhysicalOperator> inp)
Constructs an operator with the specified key and inputs
|
POStore(OperatorKey k) |
POStore(OperatorKey k,
int rp) |
POStore(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp) |
POStream(OperatorKey k,
ExecutableManager executableManager,
StreamingCommand command,
java.util.Properties properties) |
POUnion(OperatorKey k) |
POUnion(OperatorKey k,
int rp) |
POUnion(OperatorKey k,
int rp,
java.util.List<PhysicalOperator> inp) |
POUnion(OperatorKey k,
java.util.List<PhysicalOperator> inp) |
Modifier and Type | Method and Description |
---|---|
static PhysicalPlan |
PlanHelper.getLocalRearrangePlanFromSplit(PhysicalPlan plan,
OperatorKey rearrangeKey)
Finds POLocalRearrange from POSplit sub-plan
|
Modifier and Type | Field and Description |
---|---|
java.util.Map<OperatorKey,TezEdgeDescriptor> |
TezOperator.inEdges |
java.util.Map<OperatorKey,TezEdgeDescriptor> |
TezOperator.outEdges |
Modifier and Type | Method and Description |
---|---|
OperatorKey |
TezOperator.getSplitParent() |
Modifier and Type | Method and Description |
---|---|
java.util.List<OperatorKey> |
TezOperator.VertexGroupInfo.getInputs() |
java.util.List<OperatorKey> |
TezOperator.getUnionPredecessors() |
java.util.List<OperatorKey> |
TezOperator.getVertexGroupMembers() |
java.util.Map<OperatorKey,OperatorKey> |
TezOperator.getVertexGroupStores() |
java.util.Map<OperatorKey,OperatorKey> |
TezOperator.getVertexGroupStores() |
Modifier and Type | Method and Description |
---|---|
void |
TezOperator.VertexGroupInfo.addInput(OperatorKey input) |
void |
TezOperator.addUnionPredecessor(OperatorKey unionPredecessor) |
void |
TezOperator.addVertexGroupStore(OperatorKey storeKey,
OperatorKey vertexGroupKey) |
boolean |
TezOperator.VertexGroupInfo.removeInput(OperatorKey input) |
void |
TezOperator.setSplitParent(OperatorKey splitParent) |
Modifier and Type | Method and Description |
---|---|
void |
TezOperator.setVertexGroupMembers(java.util.List<OperatorKey> vertexGroupMembers) |
Constructor and Description |
---|
TezOperator(OperatorKey k) |
TezPlanContainerNode(OperatorKey k,
TezOperPlan tezPlan) |
Constructor and Description |
---|
NativeTezOper(OperatorKey k,
java.lang.String tezJar,
java.lang.String[] parameters) |
POCounterStatsTez(OperatorKey k) |
POIdentityInOutTez(OperatorKey k,
POLocalRearrange inputRearrange) |
POLocalRearrangeTez(OperatorKey k) |
POLocalRearrangeTez(OperatorKey k,
int rp) |
POPartitionRearrangeTez(OperatorKey k) |
POPartitionRearrangeTez(OperatorKey k,
int rp) |
POShuffledValueInputTez(OperatorKey k) |
POSimpleTezLoad(OperatorKey k,
FileSpec lfile) |
POStoreTez(OperatorKey k) |
POValueInputTez(OperatorKey k) |
POValueOutputTez(OperatorKey k) |
Modifier and Type | Field and Description |
---|---|
java.util.List<OperatorKey> |
TargetedTuple.targetOps |
Modifier and Type | Method and Description |
---|---|
java.util.List<OperatorKey> |
TargetedTuple.getTargetOps() |
Modifier and Type | Method and Description |
---|---|
void |
TargetedTuple.setTargetOps(java.util.List<OperatorKey> targetOps) |
Constructor and Description |
---|
TargetedTuple(Tuple t,
java.util.List<OperatorKey> targetOps) |
Modifier and Type | Field and Description |
---|---|
protected OperatorKey |
Operator.mKey
OperatorKey associated with this operator.
|
Modifier and Type | Field and Description |
---|---|
protected java.util.Map<OperatorKey,E> |
OperatorPlan.mKeys |
protected java.util.Map<E,OperatorKey> |
OperatorPlan.mOps |
Modifier and Type | Method and Description |
---|---|
static OperatorKey |
OperatorKey.genOpKey(java.lang.String scope)
Utility function for creating operator keys.
|
OperatorKey |
Operator.getOperatorKey()
Get the operator key for this operator.
|
OperatorKey |
OperatorPlan.getOperatorKey(E op)
Given an operator, find its OperatorKey.
|
Modifier and Type | Method and Description |
---|---|
java.util.Map<OperatorKey,E> |
OperatorPlan.getKeys()
Get the map of operator key and associated operators
|
Modifier and Type | Method and Description |
---|---|
int |
OperatorKey.compareTo(OperatorKey o) |
E |
OperatorPlan.getOperator(OperatorKey opKey)
Given an OperatorKey, find the associated operator.
|
Constructor and Description |
---|
Operator(OperatorKey k) |
Copyright © 2007-2012 The Apache Software Foundation