Modifier and Type | Method and Description |
---|---|
MROperPlan |
MRCompiler.compile()
The front-end method that the user calls to compile
the plan.
|
MROperPlan |
MapReduceLauncher.compile(PhysicalPlan php,
PigContext pc) |
MROperPlan |
MRCompiler.getMRPlan()
Used to get the compiled plan
|
Modifier and Type | Method and Description |
---|---|
void |
JobControlCompiler.adjustNumReducers(MROperPlan plan,
MapReduceOper mro,
org.apache.hadoop.mapreduce.Job nwJob)
Adjust the number of reducers based on the default_parallel, requested parallel and estimated
parallel.
|
org.apache.hadoop.mapred.jobcontrol.JobControl |
JobControlCompiler.compile(MROperPlan plan,
String grpName)
Compiles all jobs that have no dependencies removes them from
the plan and returns.
|
Constructor and Description |
---|
AccumulatorOptimizer(MROperPlan plan) |
CombinerOptimizer(MROperPlan plan,
boolean doMapAgg) |
CombinerOptimizer(MROperPlan plan,
boolean doMapAgg,
CompilationMessageCollector messageCollector) |
KeyTypeDiscoveryVisitor(MROperPlan plan) |
LimitAdjuster(MROperPlan plan,
PigContext pigContext) |
SampleOptimizer(MROperPlan plan,
PigContext pigContext) |
SecondaryKeyOptimizer(MROperPlan plan) |
SecondaryKeyOptimizerMR(MROperPlan plan) |
Constructor and Description |
---|
DotMRPrinter(MROperPlan plan,
PrintStream ps) |
EndOfAllInputSetter(MROperPlan plan) |
MRIntermediateDataVisitor(MROperPlan plan) |
MROpPlanVisitor(MROperPlan plan,
PlanWalker<MapReduceOper,MROperPlan> walker) |
MRPrinter(PrintStream ps,
MROperPlan plan) |
POPackageAnnotator(MROperPlan plan) |
XMLMRPrinter(PrintStream ps,
MROperPlan plan) |
Constructor and Description |
---|
MROpPlanVisitor(MROperPlan plan,
PlanWalker<MapReduceOper,MROperPlan> walker) |
Modifier and Type | Method and Description |
---|---|
void |
MRScriptState.addWorkflowAdjacenciesToConf(MROperPlan mrop,
org.apache.hadoop.conf.Configuration conf) |
static void |
MRPigStatsUtil.startCollection(PigContext pc,
org.apache.hadoop.mapred.JobClient client,
JobControlCompiler jcc,
MROperPlan plan)
Starts collecting statistics for the given MR plan
|
Copyright © 2007-2017 The Apache Software Foundation