org.apache.pig.piggybank.storage.avro

Class PigAvroRecordReader

java.lang.Object

org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Writable>

org.apache.pig.piggybank.storage.avro.PigAvroRecordReader

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public class PigAvroRecordReader
extends org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Writable>

This is an implementation of record reader which reads in avro data and convert them into pairs.

Constructor Summary

Constructors

Constructor and Description
PigAvroRecordReader(org.apache.hadoop.mapreduce.TaskAttemptContext context, org.apache.hadoop.mapreduce.lib.input.FileSplit split, org.apache.avro.Schema readerSchema, boolean ignoreBadFiles, java.util.Map<org.apache.hadoop.fs.Path,java.util.Map<java.lang.Integer,java.lang.Integer>> schemaToMergedSchemaMap, boolean useMultipleSchemas) constructor to initialize input and avro data reader

Method Summary

Methods

Modifier and Type	Method and Description
void	close()
org.apache.hadoop.io.NullWritable	getCurrentKey()
org.apache.hadoop.io.Writable	getCurrentValue()
long	getPos()
float	getProgress()
void	initialize(org.apache.hadoop.mapreduce.InputSplit arg0, org.apache.hadoop.mapreduce.TaskAttemptContext arg1)
boolean	nextKeyValue()
protected Tuple	wrapAsTuple(java.lang.Object in) Wrap non-tuple value as a tuple

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PigAvroRecordReader

public PigAvroRecordReader(org.apache.hadoop.mapreduce.TaskAttemptContext context,
                   org.apache.hadoop.mapreduce.lib.input.FileSplit split,
                   org.apache.avro.Schema readerSchema,
                   boolean ignoreBadFiles,
                   java.util.Map<org.apache.hadoop.fs.Path,java.util.Map<java.lang.Integer,java.lang.Integer>> schemaToMergedSchemaMap,
                   boolean useMultipleSchemas)
                    throws java.io.IOException

constructor to initialize input and avro data reader

Throws:

java.io.IOException

Method Detail

getProgress

public float getProgress()
                  throws java.io.IOException

Specified by:

getProgress in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Writable>

Throws:

java.io.IOException

getPos

public long getPos()
            throws java.io.IOException

Throws:

java.io.IOException

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Writable>

Throws:

java.io.IOException

getCurrentKey

public org.apache.hadoop.io.NullWritable getCurrentKey()
                                                throws java.io.IOException,
                                                       java.lang.InterruptedException

Specified by:

getCurrentKey in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Writable>

Throws:

java.io.IOException

java.lang.InterruptedException

getCurrentValue

public org.apache.hadoop.io.Writable getCurrentValue()
                                              throws java.io.IOException,
                                                     java.lang.InterruptedException

Specified by:

getCurrentValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Writable>

Throws:

java.io.IOException

java.lang.InterruptedException

wrapAsTuple

protected Tuple wrapAsTuple(java.lang.Object in)

Wrap non-tuple value as a tuple

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit arg0,
              org.apache.hadoop.mapreduce.TaskAttemptContext arg1)
                throws java.io.IOException,
                       java.lang.InterruptedException

Specified by:

initialize in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Writable>

Throws:

java.io.IOException

java.lang.InterruptedException

nextKeyValue

public boolean nextKeyValue()
                     throws java.io.IOException,
                            java.lang.InterruptedException

Specified by:

nextKeyValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Writable>

Throws:

java.io.IOException

java.lang.InterruptedException