Package org.apache.pig.backend.hadoop.executionengine.mapReduceLayer

Class Summary
AccumulatorOptimizer A visitor to optimize plans that determines if a reduce plan can run in accumulative mode.
ColumnChainInfo  
ColumnInfo  
CombinerOptimizer Optimize map reduce plans to use the combiner where possible.
DistinctCombiner A special implementation of combiner used only for distinct.
DistinctCombiner.Combine  
JobControlCompiler This is compiler class that takes an MROperPlan and converts it into a JobControl object with the relevant dependency info maintained.
JobControlCompiler.PigBagWritableComparator  
JobControlCompiler.PigCharArrayWritableComparator  
JobControlCompiler.PigDBAWritableComparator  
JobControlCompiler.PigDoubleWritableComparator  
JobControlCompiler.PigFloatWritableComparator  
JobControlCompiler.PigGroupingBagWritableComparator  
JobControlCompiler.PigGroupingCharArrayWritableComparator  
JobControlCompiler.PigGroupingDBAWritableComparator  
JobControlCompiler.PigGroupingDoubleWritableComparator  
JobControlCompiler.PigGroupingFloatWritableComparator  
JobControlCompiler.PigGroupingIntWritableComparator  
JobControlCompiler.PigGroupingLongWritableComparator  
JobControlCompiler.PigGroupingPartitionWritableComparator  
JobControlCompiler.PigGroupingTupleWritableComparator  
JobControlCompiler.PigIntWritableComparator  
JobControlCompiler.PigLongWritableComparator  
JobControlCompiler.PigSecondaryKeyGroupComparator  
JobControlCompiler.PigTupleWritableComparator  
JobControlCompiler.PigWritableComparator  
KeyTypeDiscoveryVisitor A visitor to figure out the type of the key for the map plan this is needed when the key is null to create an appropriate NullableXXXWritable object
Launcher  
MapReduceLauncher Main class that launches pig for Map Reduce
MapReduceOper An operator model for a Map Reduce job.
MapReducePOStoreImpl This class is used to have a POStore write to DFS via a output collector/record writer.
MergeJoinIndexer Merge Join indexer is used to generate on the fly index for doing Merge Join efficiently.
MRCompiler The compiler that compiles a given physical plan into a DAG of MapReduce operators which can then be converted into the JobControl structure.
NativeMapReduceOper  
PhyPlanSetter Sets the parent plan for all Physical Operators.
PigBytesRawComparator  
PigCombiner  
PigCombiner.Combine  
PigDoubleRawComparator  
PigFileInputFormat<K,V>  
PigFloatRawComparator  
PigHadoopLogger A singleton class that implements the PigLogger interface for use in map reduce context.
PigInputFormat  
PigIntRawComparator  
PigLongRawComparator  
PigMapBase  
PigMapOnly This class is the static Mapper class used by Pig to execute Pig map only jobs.
PigMapOnly.Map  
PigMapReduce This class is the static Mapper & Reducer classes that are used by Pig to execute Pig Map Reduce jobs.
PigMapReduce.Map  
PigMapReduce.MapWithComparator This "specialized" map class is ONLY to be used in pig queries with order by a udf.
PigMapReduce.MapWithPartitionIndex Used by Skewed Join
PigMapReduce.Reduce  
PigMapReduce.ReduceWithComparator This "specialized" reduce class is ONLY to be used in pig queries with order by a udf.
PigOutputCommitter A specialization of the default FileOutputCommitter to allow pig to inturn delegate calls to the OutputCommiter(s) of the StoreFunc(s)' OutputFormat(s).
PigOutputFormat The better half of PigInputFormat which is responsible for the Store functionality.
PigOutputFormat.PigRecordWriter Wrapper class which will delegate calls to the actual RecordWriter - this should only get called in the single store case.
PigRecordReader A wrapper around the actual RecordReader and loadfunc - this is needed for two reasons 1) To intercept the initialize call from hadoop and initialize the underlying actual RecordReader with the right Context object - this is achieved by looking up the Context corresponding to the input split this Reader is supposed to process 2) We need to give hadoop consistent key-value types - text and tuple respectively - so PigRecordReader will call underlying Loader's getNext() to get the Tuple value - the key is null text since key is not used in input to map() in Pig.
PigSecondaryKeyComparator  
PigSequenceFileInputFormat<K,V>  
PigSplit The main split class that maintains important information about the input split.
PigTextInputFormat  
PigTextOutputFormat  
PigTextOutputFormat.PigLineRecordWriter  
PigTextRawComparator  
PigTupleDefaultRawComparator  
PigTupleSortComparator  
ProgressableReporter  
RunJarSecurityManager  
SampleOptimizer A visitor to optimize plans that have a sample job that immediately follows a load/store only MR job.
SecondaryKeyOptimizer  
SortKeyInfo  
UDFFinishVisitor  
 

Exception Summary
JobCreationException  
MRCompilerException  
 



Copyright © ${year} The Apache Software Foundation