Package org.apache.pig.backend.hadoop.executionengine.mapReduceLayer

Interface Summary
PigReducerEstimator Interface to implement when you want to use a custom approach to estimating the number of reducers for a job.
PigStatsOutputSizeReader Interface to implement when you want to customize the way of computing the size of output in PigStats.
 

Class Summary
AccumulatorOptimizer A visitor to optimize plans that determines if a reduce plan can run in accumulative mode.
ColumnChainInfo  
ColumnInfo  
CombinerOptimizer Optimize map reduce plans to use the combiner where possible.
DistinctCombiner A special implementation of combiner used only for distinct.
DistinctCombiner.Combine  
FileBasedOutputSizeReader Class that computes the size of output for file-based systems.
IllustrateDummyReporter Dummy implementation of StatusReporter for illustrate mode
InputSizeReducerEstimator Class that estimates the number of reducers based on input size.
JobControlCompiler This is compiler class that takes an MROperPlan and converts it into a JobControl object with the relevant dependency info maintained.
JobControlCompiler.PigBagWritableComparator  
JobControlCompiler.PigBigDecimalWritableComparator  
JobControlCompiler.PigBigIntegerWritableComparator  
JobControlCompiler.PigBooleanWritableComparator  
JobControlCompiler.PigCharArrayWritableComparator  
JobControlCompiler.PigDateTimeWritableComparator  
JobControlCompiler.PigDBAWritableComparator  
JobControlCompiler.PigDoubleWritableComparator  
JobControlCompiler.PigFloatWritableComparator  
JobControlCompiler.PigGroupingBagWritableComparator  
JobControlCompiler.PigGroupingBigDecimalWritableComparator  
JobControlCompiler.PigGroupingBigIntegerWritableComparator  
JobControlCompiler.PigGroupingBooleanWritableComparator  
JobControlCompiler.PigGroupingCharArrayWritableComparator  
JobControlCompiler.PigGroupingDateTimeWritableComparator  
JobControlCompiler.PigGroupingDBAWritableComparator  
JobControlCompiler.PigGroupingDoubleWritableComparator  
JobControlCompiler.PigGroupingFloatWritableComparator  
JobControlCompiler.PigGroupingIntWritableComparator  
JobControlCompiler.PigGroupingLongWritableComparator  
JobControlCompiler.PigGroupingPartitionWritableComparator  
JobControlCompiler.PigGroupingTupleWritableComparator  
JobControlCompiler.PigIntWritableComparator  
JobControlCompiler.PigLongWritableComparator  
JobControlCompiler.PigSecondaryKeyGroupComparator  
JobControlCompiler.PigTupleWritableComparator  
JobControlCompiler.PigWritableComparator  
KeyTypeDiscoveryVisitor A visitor to figure out the type of the key for the map plan this is needed when the key is null to create an appropriate NullableXXXWritable object
LimitAdjuster  
LocalExecType LocalExecType is the ExecType for local mode in Hadoop Mapreduce.
MapReduceLauncher Main class that launches pig for Map Reduce
MapReduceOper An operator model for a Map Reduce job.
MapReducePOStoreImpl This class is used to have a POStore write to DFS via a output collector/record writer.
MergeJoinIndexer Merge Join indexer is used to generate on the fly index for doing Merge Join efficiently.
MRCompiler The compiler that compiles a given physical plan into a DAG of MapReduce operators which can then be converted into the JobControl structure.
MRExecType MRExecType is the ExecType for distributed mode in Hadoop Mapreduce.
MRExecutionEngine  
MRTaskContext  
MRUtil  
NativeMapReduceOper  
PhyPlanSetter Sets the parent plan for all Physical Operators.
PigBigDecimalRawComparator  
PigBigIntegerRawComparator  
PigBooleanRawComparator  
PigBytesRawComparator  
PigCombiner  
PigCombiner.Combine  
PigDateTimeRawComparator  
PigDoubleRawComparator  
PigFileInputFormat<K,V>  
PigFloatRawComparator  
PigGenericMapBase This class is the base class for PigMapBase, which has slightly difference among different versions of hadoop.
PigGenericMapReduce This class is the static Mapper & Reducer classes that are used by Pig to execute Pig Map Reduce jobs.
PigGenericMapReduce.Map  
PigGenericMapReduce.MapWithComparator This "specialized" map class is ONLY to be used in pig queries with order by a udf.
PigGenericMapReduce.MapWithPartitionIndex Used by Skewed Join
PigGenericMapReduce.Reduce  
PigGenericMapReduce.ReduceWithComparator This "specialized" reduce class is ONLY to be used in pig queries with order by a udf.
PigHadoopLogger A singleton class that implements the PigLogger interface for use in map reduce context.
PigInputFormat  
PigIntRawComparator  
PigLongRawComparator  
PigMapOnly This class is the static Mapper class used by Pig to execute Pig map only jobs.
PigMapOnly.Map  
PigMapReduceCounter  
PigMapReduceCounter.PigMapCounter This class is the used only for simple RANK operation, namely row number mode.
PigMapReduceCounter.PigReduceCounter This class is the used for RANK BY operations, independently if it is dense or not.
PigOutputCommitter A specialization of the default FileOutputCommitter to allow pig to inturn delegate calls to the OutputCommiter(s) of the StoreFunc(s)' OutputFormat(s).
PigOutputFormat The better half of PigInputFormat which is responsible for the Store functionality.
PigOutputFormat.PigRecordWriter Wrapper class which will delegate calls to the actual RecordWriter - this should only get called in the single store case.
PigRecordReader A wrapper around the actual RecordReader and loadfunc - this is needed for two reasons 1) To intercept the initialize call from hadoop and initialize the underlying actual RecordReader with the right Context object - this is achieved by looking up the Context corresponding to the input split this Reader is supposed to process 2) We need to give hadoop consistent key-value types - text and tuple respectively - so PigRecordReader will call underlying Loader's getNext() to get the Tuple value - the key is null text since key is not used in input to map() in Pig.
PigSecondaryKeyComparator  
PigSequenceFileInputFormat<K,V>  
PigSplit The main split class that maintains important information about the input split.
PigTextInputFormat  
PigTextOutputFormat  
PigTextOutputFormat.PigLineRecordWriter  
PigTextRawComparator  
PigTupleDefaultRawComparator  
PigTupleSortComparator  
ProgressableReporter  
RunJarSecurityManager  
SampleOptimizer A visitor to optimize plans that have a sample job that immediately follows a load/store only MR job.
SecondaryKeyOptimizer  
SortKeyInfo  
UDFFinishVisitor  
 

Exception Summary
MRCompilerException  
 



Copyright © 2007-2012 The Apache Software Foundation