| Package | Description |
|---|---|
| org.apache.pig.backend.hadoop.executionengine.mapReduceLayer | |
| org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans | |
| org.apache.pig.backend.hadoop.executionengine.physicalLayer |
Implementation of physical operators that use hadoop as the execution engine
and data storage.
|
| org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans | |
| org.apache.pig.backend.hadoop.executionengine.tez | |
| org.apache.pig.backend.hadoop.executionengine.tez.plan | |
| org.apache.pig.backend.hadoop.executionengine.tez.plan.optimizer | |
| org.apache.pig.backend.hadoop.executionengine.util | |
| org.apache.pig.impl.plan | |
| org.apache.pig.pen | |
| org.apache.pig.tools.pigstats |
| Modifier and Type | Class and Description |
|---|---|
class |
AccumulatorOptimizer
A visitor to optimize plans that determines if a reduce plan can run in
accumulative mode.
|
class |
CombinerOptimizer
Optimize map reduce plans to use the combiner where possible.
|
class |
KeyTypeDiscoveryVisitor
A visitor to figure out the type of the key for the map plan
this is needed when the key is null to create
an appropriate NullableXXXWritable object
|
class |
LimitAdjuster |
class |
MRCompiler
The compiler that compiles a given physical plan
into a DAG of MapReduce operators which can then
be converted into the JobControl structure.
|
class |
PhyPlanSetter
Sets the parent plan for all Physical Operators.
|
class |
SampleOptimizer
A visitor to optimize plans that have a sample job that immediately follows a
load/store only MR job.
|
class |
SecondaryKeyOptimizer |
class |
SecondaryKeyOptimizerMR |
class |
UDFFinishVisitor |
| Modifier and Type | Class and Description |
|---|---|
class |
EndOfAllInputSetter
This visitor visits the MRPlan and does the following
for each MROper: If the map plan or the reduce plan of the MROper has
an end of all input flag present in it, this marks in the MROper whether the map
has an end of all input flag set or if the reduce has an end of all input flag set.
|
static class |
EndOfAllInputSetter.EndOfAllInputChecker |
class |
MRIntermediateDataVisitor
An
MROpPlanVisitor that gathers the paths for all
intermediate data from a MROperPlan |
class |
MROpPlanVisitor
A visitor for the MROperPlan class
|
class |
MRPrinter
A visitor mechanism printing out the logical plan.
|
class |
POPackageAnnotator
This visitor visits the MRPlan and does the following
for each MROper
- visits the POPackage in the reduce plan and finds the corresponding
POLocalRearrange(s) (either in the map plan of the same oper OR
reduce plan of predecessor MROper).
|
class |
ScalarPhyFinder |
class |
UDFFinder |
class |
XMLMRPrinter
A visitor mechanism printing out the logical plan.
|
| Modifier and Type | Method and Description |
|---|---|
void |
DotMRPrinter.InnerOperator.visit(PlanVisitor v) |
| Modifier and Type | Class and Description |
|---|---|
class |
POPrinter |
| Modifier and Type | Class and Description |
|---|---|
class |
PhyPlanVisitor
The visitor class for the Physical Plan.
|
class |
PlanPrinter<O extends Operator,P extends OperatorPlan<O>> |
class |
UdfCacheShipFilesVisitor |
class |
XMLPhysicalPlanPrinter<P extends OperatorPlan<PhysicalOperator>> |
| Modifier and Type | Class and Description |
|---|---|
class |
TezDagBuilder
A visitor to construct DAG out of Tez plan.
|
| Modifier and Type | Class and Description |
|---|---|
class |
TezCompiler
The compiler that compiles a given physical plan into a DAG of Tez
operators which can then be converted into the JobControl structure.
|
class |
TezOpPlanVisitor
A visitor for the TezOperPlan class
|
class |
TezPlanContainerPrinter |
class |
TezPlanContainerUDFCollector |
class |
TezPlanContainerVisitor |
class |
TezPOPackageAnnotator
A port of the POPackageAnnotator from MR to Tez.
|
static class |
TezPOPackageAnnotator.LoRearrangeDiscoverer
Physical Plan visitor which tries to get the
LocalRearrange(s) present in the plan (if any) and
annotate the POPackage given to it with the information
in the LocalRearrange (regarding columns in the "value"
present in the "key")
|
class |
TezPOStreamVisitor |
class |
TezPOUserFuncVisitor |
class |
TezPrinter
A visitor to print out the Tez plan.
|
static class |
TezPrinter.TezGraphPrinter
This class prints the Tez Vertex Graph
|
| Modifier and Type | Class and Description |
|---|---|
class |
LoaderProcessor |
class |
MultiQueryOptimizerTez |
class |
NoopFilterRemover
For historical reasons splits will always produce filters that pass
everything through unchanged.
|
class |
ParallelismSetter |
class |
SecondaryKeyOptimizerTez |
static class |
TezOperDependencyParallelismEstimator.TezParallelismFactorVisitor |
class |
UnionOptimizer
Optimizes union by removing the intermediate union vertex and making the
successor get input from the predecessor vertices directly using VertexGroup.
|
| Modifier and Type | Class and Description |
|---|---|
class |
ParallelConstantVisitor |
| Modifier and Type | Class and Description |
|---|---|
class |
Operator<V extends PlanVisitor>
Base class for all types of operators.
|
| Modifier and Type | Method and Description |
|---|---|
void |
ReverseDependencyOrderWalker.walk(PlanVisitor<O,P> visitor)
Begin traversing the graph.
|
abstract void |
PlanWalker.walk(PlanVisitor<O,P> visitor)
Begin traversing the graph.
|
void |
DepthFirstWalker.walk(PlanVisitor<O,P> visitor)
Begin traversing the graph.
|
void |
DependencyOrderWalker.walk(PlanVisitor<O,P> visitor)
Begin traversing the graph.
|
| Modifier and Type | Class and Description |
|---|---|
class |
IllustratorAttacher
The class used to (re)attach illustrators to physical operators
|
class |
PhysicalPlanResetter
This visitor visits the physical plan and resets it for next MRCompilation
|
| Modifier and Type | Class and Description |
|---|---|
protected static class |
ScriptState.AliasVisitor |
protected static class |
ScriptState.FeatureVisitor |
Copyright © 2007-2012 The Apache Software Foundation