Interface | Description |
---|---|
PigReducerEstimator |
Interface to implement when you want to use a custom approach to estimating
the number of reducers for a job.
|
PigStatsOutputSizeReader |
Interface to implement when you want to customize the way of computing the
size of output in PigStats.
|
Class | Description |
---|---|
AccumulatorOptimizer |
A visitor to optimize plans that determines if a reduce plan can run in
accumulative mode.
|
ColumnChainInfo | |
ColumnInfo | |
CombinerOptimizer |
Optimize map reduce plans to use the combiner where possible.
|
DistinctCombiner |
A special implementation of combiner used only for distinct.
|
DistinctCombiner.Combine | |
FileBasedOutputSizeReader |
Class that computes the size of output for file-based systems.
|
IllustrateDummyReporter |
Dummy implementation of StatusReporter for illustrate mode
|
InputSizeReducerEstimator |
Class that estimates the number of reducers based on input size.
|
JobControlCompiler |
This is compiler class that takes an MROperPlan and converts
it into a JobControl object with the relevant dependency info
maintained.
|
JobControlCompiler.PigBagWritableComparator | |
JobControlCompiler.PigBigDecimalWritableComparator | |
JobControlCompiler.PigBigIntegerWritableComparator | |
JobControlCompiler.PigBooleanWritableComparator | |
JobControlCompiler.PigCharArrayWritableComparator | |
JobControlCompiler.PigDateTimeWritableComparator | |
JobControlCompiler.PigDBAWritableComparator | |
JobControlCompiler.PigDoubleWritableComparator | |
JobControlCompiler.PigFloatWritableComparator | |
JobControlCompiler.PigGroupingBagWritableComparator | |
JobControlCompiler.PigGroupingBigDecimalWritableComparator | |
JobControlCompiler.PigGroupingBigIntegerWritableComparator | |
JobControlCompiler.PigGroupingBooleanWritableComparator | |
JobControlCompiler.PigGroupingCharArrayWritableComparator | |
JobControlCompiler.PigGroupingDateTimeWritableComparator | |
JobControlCompiler.PigGroupingDBAWritableComparator | |
JobControlCompiler.PigGroupingDoubleWritableComparator | |
JobControlCompiler.PigGroupingFloatWritableComparator | |
JobControlCompiler.PigGroupingIntWritableComparator | |
JobControlCompiler.PigGroupingLongWritableComparator | |
JobControlCompiler.PigGroupingPartitionWritableComparator | |
JobControlCompiler.PigGroupingTupleWritableComparator | |
JobControlCompiler.PigIntWritableComparator | |
JobControlCompiler.PigLongWritableComparator | |
JobControlCompiler.PigSecondaryKeyGroupComparator | |
JobControlCompiler.PigTupleWritableComparator | |
JobControlCompiler.PigWritableComparator | |
KeyTypeDiscoveryVisitor |
A visitor to figure out the type of the key for the map plan
this is needed when the key is null to create
an appropriate NullableXXXWritable object
|
LimitAdjuster | |
LocalExecType |
LocalExecType is the ExecType for local mode in Hadoop Mapreduce.
|
MapReduceLauncher |
Main class that launches pig for Map Reduce
|
MapReduceOper |
An operator model for a Map Reduce job.
|
MapReducePOStoreImpl |
This class is used to have a POStore write to DFS via a output
collector/record writer.
|
MergeJoinIndexer |
Merge Join indexer is used to generate on the fly index for doing Merge Join efficiently.
|
MRCompiler |
The compiler that compiles a given physical plan
into a DAG of MapReduce operators which can then
be converted into the JobControl structure.
|
MRConfiguration | |
MRExecType |
MRExecType is the ExecType for distributed mode in Hadoop Mapreduce.
|
MRExecutionEngine | |
MRTaskContext | |
MRUtil | |
NativeMapReduceOper | |
PhyPlanSetter |
Sets the parent plan for all Physical Operators.
|
PigBigDecimalRawComparator | |
PigBigIntegerRawComparator | |
PigBooleanRawComparator | |
PigBytesRawComparator | |
PigCombiner | |
PigCombiner.Combine | |
PigDateTimeRawComparator | |
PigDoubleRawComparator | |
PigFileInputFormat<K,V> | |
PigFloatRawComparator | |
PigGenericMapBase |
This class is the base class for PigMapBase, which has slightly
difference among different versions of hadoop.
|
PigGenericMapReduce |
This class is the static Mapper & Reducer classes that
are used by Pig to execute Pig Map Reduce jobs.
|
PigGenericMapReduce.Map | |
PigGenericMapReduce.MapWithComparator |
This "specialized" map class is ONLY to be used in pig queries with
order by a udf.
|
PigGenericMapReduce.MapWithPartitionIndex |
Used by Skewed Join
|
PigGenericMapReduce.Reduce | |
PigGenericMapReduce.ReduceWithComparator |
This "specialized" reduce class is ONLY to be used in pig queries with
order by a udf.
|
PigHadoopLogger |
A singleton class that implements the PigLogger interface
for use in map reduce context.
|
PigInputFormat | |
PigIntRawComparator | |
PigLongRawComparator | |
PigMapOnly |
This class is the static Mapper class used by Pig
to execute Pig map only jobs.
|
PigMapOnly.Map | |
PigMapReduceCounter | |
PigMapReduceCounter.PigMapCounter |
This class is the used only for simple RANK operation, namely row number mode.
|
PigMapReduceCounter.PigReduceCounter |
This class is the used for RANK BY operations, independently if it is dense or not.
|
PigOutputCommitter |
A specialization of the default FileOutputCommitter to allow
pig to inturn delegate calls to the OutputCommiter(s) of the
StoreFunc(s)' OutputFormat(s).
|
PigOutputFormat |
The better half of PigInputFormat which is responsible
for the Store functionality.
|
PigOutputFormat.PigRecordWriter |
Wrapper class which will delegate calls to the actual RecordWriter - this
should only get called in the single store case.
|
PigRecordReader |
A wrapper around the actual RecordReader and loadfunc - this is needed for
two reasons
1) To intercept the initialize call from hadoop and initialize the underlying
actual RecordReader with the right Context object - this is achieved by
looking up the Context corresponding to the input split this Reader is
supposed to process
2) We need to give hadoop consistent key-value types - text and tuple
respectively - so PigRecordReader will call underlying Loader's getNext() to
get the Tuple value - the key is null text since key is not used in input to
map() in Pig.
|
PigSecondaryKeyComparator | |
PigSequenceFileInputFormat<K,V> | |
PigSplit |
The main split class that maintains important
information about the input split.
|
PigTextInputFormat | |
PigTextOutputFormat | |
PigTextOutputFormat.PigLineRecordWriter | |
PigTextRawComparator | |
PigTupleDefaultRawComparator | |
PigTupleSortComparator | |
ProgressableReporter | |
RunJarSecurityManager | |
SampleOptimizer |
A visitor to optimize plans that have a sample job that immediately follows a
load/store only MR job.
|
SecondaryKeyOptimizer | |
SecondaryKeyOptimizerMR | |
SortKeyInfo | |
UDFFinishVisitor |
Exception | Description |
---|---|
MRCompilerException |
Copyright © 2007-2012 The Apache Software Foundation