org.apache.pig.piggybank.storage

Class IndexedStorage.IndexedStorageOutputFormat

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<K,V>

org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<K,V>

org.apache.hadoop.mapreduce.lib.output.TextOutputFormat<org.apache.hadoop.io.WritableComparable,Tuple>

org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextOutputFormat

org.apache.pig.piggybank.storage.IndexedStorage.IndexedStorageOutputFormat

Enclosing class:

IndexedStorage

public static class IndexedStorage.IndexedStorageOutputFormat
extends PigTextOutputFormat

Internal OutputFormat class

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	IndexedStorage.IndexedStorageOutputFormat.IndexedStorageRecordWriter Internal class to do the actual record writing and index generation

Nested classes/interfaces inherited from class org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextOutputFormat

PigTextOutputFormat.PigLineRecordWriter

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat

org.apache.hadoop.mapreduce.lib.output.TextOutputFormat.LineRecordWriter<K,V>

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.Counter

Field Summary

Fields

Modifier and Type	Field and Description
protected int[]	offsetsToIndexKeys Offsets to index keys in given tuple

Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

BASE_OUTPUT_NAME, PART

Constructor Summary

Constructors

Constructor and Description
IndexedStorage.IndexedStorageOutputFormat(byte delimiter, int[] offsetsToIndexKeys)

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.WritableComparable,Tuple>	getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)

Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

checkOutputSpecs, getCompressOutput, getDefaultWorkFile, getOutputCommitter, getOutputCompressorClass, getOutputName, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputName, setOutputPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

offsetsToIndexKeys

protected final int[] offsetsToIndexKeys

Offsets to index keys in given tuple

Constructor Detail

IndexedStorage.IndexedStorageOutputFormat

public IndexedStorage.IndexedStorageOutputFormat(byte delimiter,
                                         int[] offsetsToIndexKeys)

Method Detail

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<org.apache.hadoop.io.WritableComparable,Tuple> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                        throws java.io.IOException,
                                                                                                               java.lang.InterruptedException

Overrides:

getRecordWriter in class PigTextOutputFormat

Throws:

java.io.IOException

java.lang.InterruptedException