@InterfaceAudience.Public @InterfaceStability.Evolving public interface PigReducerEstimator
InputSizeReducerEstimator
Modifier and Type | Field and Description |
---|---|
static String |
BYTES_PER_REDUCER_PARAM |
static long |
DEFAULT_BYTES_PER_REDUCER |
static int |
DEFAULT_MAX_REDUCER_COUNT_PARAM |
static String |
MAX_REDUCER_COUNT_PARAM |
Modifier and Type | Method and Description |
---|---|
int |
estimateNumberOfReducers(org.apache.hadoop.mapreduce.Job job,
MapReduceOper mapReduceOper)
Estimate the number of reducers for a given job based on the collection
of load funcs passed.
|
static final String BYTES_PER_REDUCER_PARAM
static final String MAX_REDUCER_COUNT_PARAM
static final long DEFAULT_BYTES_PER_REDUCER
static final int DEFAULT_MAX_REDUCER_COUNT_PARAM
int estimateNumberOfReducers(org.apache.hadoop.mapreduce.Job job, MapReduceOper mapReduceOper) throws IOException
job
- job instancemapReduceOper
- map reducer operator of the jobIOException
Copyright © 2007-2017 The Apache Software Foundation