org.apache.pig.piggybank.storage

Class IndexedStorage.IndexedStorageInputFormat.IndexedStorageRecordReader

java.lang.Object

org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

org.apache.pig.piggybank.storage.IndexedStorage.IndexedStorageInputFormat.IndexedStorageRecordReader

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

Enclosing class:

IndexedStorage.IndexedStorageInputFormat

public static class IndexedStorage.IndexedStorageInputFormat.IndexedStorageRecordReader
extends org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Internal RecordReader class

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	IndexedStorage.IndexedStorageInputFormat.IndexedStorageRecordReader.IndexedStorageLineReader
static class	IndexedStorage.IndexedStorageInputFormat.IndexedStorageRecordReader.IndexedStorageRecordReaderComparator Class to compare record readers using underlying indexes

Constructor Summary

Constructors

Constructor and Description
IndexedStorage.IndexedStorageInputFormat.IndexedStorageRecordReader(IndexedStorage.IndexManager im)

Method Summary

Methods

Modifier and Type	Method and Description
void	close()
org.apache.hadoop.io.LongWritable	getCurrentKey()
org.apache.hadoop.io.Text	getCurrentValue()
float	getProgress()
void	initialize(org.apache.hadoop.mapreduce.InputSplit genericSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context)
boolean	nextKeyValue()
void	seek(long offset)
boolean	seekNear(Tuple keys) Scan the index for given key and seek to appropriate offset in the data
java.lang.String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

IndexedStorage.IndexedStorageInputFormat.IndexedStorageRecordReader

public IndexedStorage.IndexedStorageInputFormat.IndexedStorageRecordReader(IndexedStorage.IndexManager im)

Method Detail

toString

public java.lang.String toString()

Overrides:

toString in class java.lang.Object

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit genericSplit,
              org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws java.io.IOException,
                       java.lang.InterruptedException

Specified by:

initialize in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

seek

public void seek(long offset)
          throws java.io.IOException

Throws:

java.io.IOException

seekNear

public boolean seekNear(Tuple keys)
                 throws java.io.IOException

Scan the index for given key and seek to appropriate offset in the data

Parameters:

keys - to look for

Returns:

true if the given key was found, false otherwise

Throws:

java.io.IOException

nextKeyValue

public boolean nextKeyValue()
                     throws java.io.IOException,
                            java.lang.InterruptedException

Specified by:

nextKeyValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

getCurrentKey

public org.apache.hadoop.io.LongWritable getCurrentKey()
                                                throws java.io.IOException,
                                                       java.lang.InterruptedException

Specified by:

getCurrentKey in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

getCurrentValue

public org.apache.hadoop.io.Text getCurrentValue()
                                          throws java.io.IOException,
                                                 java.lang.InterruptedException

Specified by:

getCurrentValue in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

getProgress

public float getProgress()
                  throws java.io.IOException,
                         java.lang.InterruptedException

Specified by:

getProgress in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException

java.lang.InterruptedException

close

public void close()
           throws java.io.IOException

Specified by:

close in interface java.io.Closeable

Specified by:

close in interface java.lang.AutoCloseable

Specified by:

close in class org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text>

Throws:

java.io.IOException