org.apache.pig.impl.io

Class InterRecordReader

java.lang.Object

org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,Tuple>

org.apache.pig.impl.io.InterRecordReader

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public class InterRecordReader
extends org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,Tuple>

A record reader used to read data written using InterRecordWriter It uses the default InterSedes object for deserialization.

Constructor Summary

Constructors

Constructor and Description
InterRecordReader(int syncMarkerLength, long syncMarkerInterval)

Method Summary

Modifier and Type	Method and Description
void	close()
org.apache.hadoop.io.Text	getCurrentKey()
Tuple	getCurrentValue()
float	getProgress() Get the progress within the split
void	initialize(org.apache.hadoop.mapreduce.InputSplit genericSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context)
boolean	nextKeyValue()
boolean	skipUntilMarkerOrSplitEndOrEOF() Skips to next sync marker

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

InterRecordReader

public InterRecordReader(int syncMarkerLength,
                         long syncMarkerInterval)

Method Detail

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit genericSplit,
                       org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws java.io.IOException

Specified by:

initialize in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,Tuple>

Throws:

java.io.IOException

skipUntilMarkerOrSplitEndOrEOF

public boolean skipUntilMarkerOrSplitEndOrEOF()
                                       throws java.io.IOException

Skips to next sync marker

Returns:

true if marker was observed, false if EOF or EndOfSplit was reached

Throws:

java.io.IOException

nextKeyValue

public boolean nextKeyValue()
                     throws java.io.IOException

Specified by:

nextKeyValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,Tuple>

Throws:

java.io.IOException

getCurrentKey

public org.apache.hadoop.io.Text getCurrentKey()

Specified by:

getCurrentKey in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,Tuple>

getCurrentValue

public Tuple getCurrentValue()

Specified by:

getCurrentValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,Tuple>

getProgress

public float getProgress()

Get the progress within the split

Specified by:

getProgress in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,Tuple>

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,Tuple>

Throws:

java.io.IOException