Modifier and Type | Class and Description |
---|---|
class |
NativeMapReduceOper |
Modifier and Type | Method and Description |
---|---|
Map<org.apache.hadoop.mapred.jobcontrol.Job,MapReduceOper> |
JobControlCompiler.getJobMroMap()
Gets the map of Job and the MR Operator
|
Modifier and Type | Method and Description |
---|---|
void |
JobControlCompiler.adjustNumReducers(MROperPlan plan,
MapReduceOper mro,
org.apache.hadoop.mapreduce.Job nwJob)
Adjust the number of reducers based on the default_parallel, requested parallel and estimated
parallel.
|
int |
PigReducerEstimator.estimateNumberOfReducers(org.apache.hadoop.mapreduce.Job job,
MapReduceOper mapReduceOper)
Estimate the number of reducers for a given job based on the collection
of load funcs passed.
|
static int |
JobControlCompiler.estimateNumberOfReducers(org.apache.hadoop.mapreduce.Job job,
MapReduceOper mapReducerOper)
Looks up the estimator from REDUCER_ESTIMATOR_KEY and invokes it to find the number of
reducers to use.
|
int |
InputSizeReducerEstimator.estimateNumberOfReducers(org.apache.hadoop.mapreduce.Job job,
MapReduceOper mapReduceOper)
Determines the number of reducers to be used.
|
static void |
MRUtil.simpleConnectMapToReduce(MapReduceOper mro,
String scope,
NodeIdGenerator nig) |
void |
SecondaryKeyOptimizerMR.visitMROp(MapReduceOper mr) |
void |
SecondaryKeyOptimizer.visitMROp(MapReduceOper mr) |
void |
SampleOptimizer.visitMROp(MapReduceOper mr) |
void |
LimitAdjuster.visitMROp(MapReduceOper mr) |
void |
KeyTypeDiscoveryVisitor.visitMROp(MapReduceOper mr) |
void |
CombinerOptimizer.visitMROp(MapReduceOper mr) |
void |
AccumulatorOptimizer.visitMROp(MapReduceOper mr) |
Modifier and Type | Method and Description |
---|---|
protected String[] |
DotMRPrinter.getAttributes(MapReduceOper op) |
protected String |
DotMRPrinter.getName(MapReduceOper op) |
protected Collection<DotMRPrinter.InnerPlan> |
DotMRPrinter.getNestedPlans(MapReduceOper op) |
void |
XMLMRPrinter.visitMROp(MapReduceOper mr) |
void |
POPackageAnnotator.visitMROp(MapReduceOper mr) |
void |
MRPrinter.visitMROp(MapReduceOper mr) |
void |
MROpPlanVisitor.visitMROp(MapReduceOper mr) |
void |
MRIntermediateDataVisitor.visitMROp(MapReduceOper mr) |
void |
EndOfAllInputSetter.visitMROp(MapReduceOper mr) |
Constructor and Description |
---|
MROpPlanVisitor(MROperPlan plan,
PlanWalker<MapReduceOper,MROperPlan> walker) |
Modifier and Type | Method and Description |
---|---|
void |
MRScriptState.addSettingsToConf(MapReduceOper mro,
org.apache.hadoop.conf.Configuration conf) |
String |
MRScriptState.getAlias(MapReduceOper mro) |
String |
MRScriptState.getAliasLocation(MapReduceOper mro) |
String |
MRScriptState.getPigFeature(MapReduceOper mro) |
Modifier and Type | Method and Description |
---|---|
static void |
MRPigStatsUtil.updateJobMroMap(Map<org.apache.hadoop.mapred.jobcontrol.Job,MapReduceOper> jobMroMap)
Updates the
PigStats.JobGraph of the PigStats . |
Copyright © 2007-2017 The Apache Software Foundation