org.apache.pig.backend.hadoop.executionengine.mapReduceLayer

Class PigInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.Text,Tuple>

org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat

Direct Known Subclasses:

PigInputFormatTez

public class PigInputFormat
extends org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.Text,Tuple>

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.commons.logging.Log	log
static String	PIG_INPUT_LIMITS
static String	PIG_INPUT_SIGNATURES
static String	PIG_INPUT_TARGETS
static String	PIG_INPUTS
static org.apache.hadoop.conf.Configuration	sJob Deprecated. Use UDFContext instead in the following way to get the job's Configuration: UdfContext.getUdfContext().getJobConf()

Constructor Summary

Constructors

Constructor and Description
PigInputFormat()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,Tuple>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
static PigSplit	getActiveSplit()
protected List<org.apache.hadoop.mapreduce.InputSplit>	getPigSplits(List<org.apache.hadoop.mapreduce.InputSplit> oneInputSplits, int inputIndex, ArrayList<OperatorKey> targetOps, long blockSize, boolean combinable, org.apache.hadoop.conf.Configuration conf)
List<org.apache.hadoop.mapreduce.InputSplit>	getSplits(org.apache.hadoop.mapreduce.JobContext jobcontext)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

log

public static final org.apache.commons.logging.Log log

PIG_INPUTS

public static final String PIG_INPUTS

See Also:

Constant Field Values

PIG_INPUT_TARGETS

public static final String PIG_INPUT_TARGETS

See Also:

Constant Field Values

PIG_INPUT_SIGNATURES

public static final String PIG_INPUT_SIGNATURES

See Also:

Constant Field Values

PIG_INPUT_LIMITS

public static final String PIG_INPUT_LIMITS

See Also:

Constant Field Values

sJob

@Deprecated
public static org.apache.hadoop.conf.Configuration sJob

Deprecated. Use UDFContext instead in the following way to get the job's Configuration:

UdfContext.getUdfContext().getJobConf()

Constructor Detail

PigInputFormat

public PigInputFormat()

Method Detail

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,Tuple> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                           org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                             throws IOException,
                                                                                                    InterruptedException

Specified by:

createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.Text,Tuple>

Throws:

IOException

InterruptedException

getSplits

public List<org.apache.hadoop.mapreduce.InputSplit> getSplits(org.apache.hadoop.mapreduce.JobContext jobcontext)
                                                       throws IOException,
                                                              InterruptedException

Specified by:

getSplits in class org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.Text,Tuple>

Throws:

IOException

InterruptedException

getPigSplits

protected List<org.apache.hadoop.mapreduce.InputSplit> getPigSplits(List<org.apache.hadoop.mapreduce.InputSplit> oneInputSplits,
                                                        int inputIndex,
                                                        ArrayList<OperatorKey> targetOps,
                                                        long blockSize,
                                                        boolean combinable,
                                                        org.apache.hadoop.conf.Configuration conf)
                                                             throws IOException,
                                                                    InterruptedException

Throws:

IOException

InterruptedException

getActiveSplit

public static PigSplit getActiveSplit()