Modifier and Type | Field and Description |
---|---|
HashMap<String,ArrayList<Pair<String,Long>>> |
JobControlCompiler.globalCounters |
Modifier and Type | Method and Description |
---|---|
org.apache.hadoop.mapreduce.Mapper.Context |
PigMapBase.getIllustratorContext(org.apache.hadoop.conf.Configuration conf,
DataBag input,
List<Pair<PigNullableWritable,org.apache.hadoop.io.Writable>> output,
org.apache.hadoop.mapreduce.InputSplit split)
Get mapper's illustrator context
|
abstract org.apache.hadoop.mapreduce.Mapper.Context |
PigGenericMapBase.getIllustratorContext(org.apache.hadoop.conf.Configuration conf,
DataBag input,
List<Pair<PigNullableWritable,org.apache.hadoop.io.Writable>> output,
org.apache.hadoop.mapreduce.InputSplit split) |
org.apache.hadoop.mapreduce.Reducer.Context |
PigMapReduce.Reduce.getIllustratorContext(org.apache.hadoop.mapred.jobcontrol.Job job,
List<Pair<PigNullableWritable,org.apache.hadoop.io.Writable>> input,
POPackage pkg)
Get reducer's illustrator context
|
abstract org.apache.hadoop.mapreduce.Reducer.Context |
PigGenericMapReduce.Reduce.getIllustratorContext(org.apache.hadoop.mapred.jobcontrol.Job job,
List<Pair<PigNullableWritable,org.apache.hadoop.io.Writable>> input,
POPackage pkg)
Get reducer's illustrator context
|
Constructor and Description |
---|
IllustratorContext(org.apache.hadoop.conf.Configuration conf,
DataBag input,
List<Pair<PigNullableWritable,org.apache.hadoop.io.Writable>> output,
org.apache.hadoop.mapreduce.InputSplit split) |
IllustratorContextImpl(org.apache.hadoop.mapred.jobcontrol.Job job,
List<Pair<PigNullableWritable,org.apache.hadoop.io.Writable>> input,
POPackage pkg) |
Modifier and Type | Field and Description |
---|---|
protected Map<Object,Pair<Integer,Integer>> |
SkewedPartitioner.reducerMap |
Modifier and Type | Field and Description |
---|---|
protected Map<Integer,Pair<Boolean,Map<Integer,Integer>>> |
Packager.keyInfo |
Modifier and Type | Method and Description |
---|---|
Map<Integer,Pair<Boolean,Map<Integer,Integer>>> |
Packager.getKeyInfo() |
Modifier and Type | Method and Description |
---|---|
void |
Packager.setKeyInfo(Map<Integer,Pair<Boolean,Map<Integer,Integer>>> keyInfo) |
void |
CombinerPackager.setKeyInfo(Map<Integer,Pair<Boolean,Map<Integer,Integer>>> keyInfo) |
Modifier and Type | Method and Description |
---|---|
static Pair<POProject,Byte>[] |
TezCompiler.getSortCols(List<PhysicalPlan> plans) |
Modifier and Type | Method and Description |
---|---|
static Map<Object,Pair<Integer,Integer>> |
TezRuntimeUtil.readReduceMapFromSample(TupleFactory tf) |
Modifier and Type | Method and Description |
---|---|
static List<Pair<PhysicalOperator,PhysicalPlan>> |
CombinerOptimizerUtil.findAlgebraicOps(List<PhysicalPlan> feInners)
find algebraic operators and also check if the foreach statement is
suitable for combiner use
|
static <E> Map<E,Pair<Integer,Integer>> |
MapRedUtil.loadPartitionFileFromLocalCache(String keyDistFile,
Integer[] totalReducers,
byte keyType,
org.apache.hadoop.conf.Configuration mapConf)
Loads the key distribution sampler file
|
Modifier and Type | Field and Description |
---|---|
protected Map<Object,Pair<Integer,Integer>> |
IsFirstReduceOfKey.reducerMap |
Modifier and Type | Method and Description |
---|---|
void |
SampleLoader.computeSamples(ArrayList<Pair<FileSpec,Boolean>> inputs,
PigContext pc) |
Modifier and Type | Method and Description |
---|---|
Pair<Integer,Integer> |
RequiredFields.getField(int i) |
Pair<Integer,Integer> |
ProjectionMap.Column.getInputColumn()
Get the mapped column details
|
Modifier and Type | Method and Description |
---|---|
List<Pair<Integer,Integer>> |
RequiredFields.getFields() |
List<Pair<Integer,Integer>> |
ProjectionMap.getRemovedFields() |
Modifier and Type | Method and Description |
---|---|
void |
RequiredFields.setFields(List<Pair<Integer,Integer>> fields) |
void |
ProjectionMap.setRemovedFields(List<Pair<Integer,Integer>> fields) |
Constructor and Description |
---|
Column(Pair<Integer,Integer> inputColumn) |
Column(Pair<Integer,Integer> inputColumn,
boolean cast,
byte castType) |
Constructor and Description |
---|
ProjectionMap(MultiMap<Integer,ProjectionMap.Column> mapFields,
List<Pair<Integer,Integer>> removedFields,
List<Integer> addedFields) |
RequiredFields(List<Pair<Integer,Integer>> fields) |
Modifier and Type | Method and Description |
---|---|
Pair<Integer,Integer> |
OperatorSubPlan.disconnect(Operator from,
Operator to) |
Pair<Integer,Integer> |
OperatorPlan.disconnect(Operator from,
Operator to)
Disconnect two operators in the plan.
|
Pair<Integer,Integer> |
BaseOperatorPlan.disconnect(Operator from,
Operator to)
Disconnect two operators in the plan.
|
Pair<Operator,Integer> |
PlanEdge.removeWithPosition(Operator key,
Operator value)
Remove one value from an existing key and return which position in
the arraylist the value was at..
|
Modifier and Type | Method and Description |
---|---|
static Pair<List<LOInnerLoad>,Boolean> |
LOForEach.findReacheableInnerLoadFromBoundaryProject(ProjectExpression project) |
Modifier and Type | Method and Description |
---|---|
void |
ColumnPruneVisitor.addRequiredItems(LOLoad load,
Pair<Map<Integer,Set<String>>,Set<Integer>> requiredItem) |
Constructor and Description |
---|
ColumnPruneVisitor(OperatorPlan plan,
Map<LOLoad,Pair<Map<Integer,Set<String>>,Set<Integer>>> requiredItems,
boolean columnPrune) |
Copyright © 2007-2017 The Apache Software Foundation