org.apache.pig.backend.hadoop.executionengine.spark

Class SparkPigRecordReader

java.lang.Object

org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.Text,Tuple>

org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader

org.apache.pig.backend.hadoop.executionengine.spark.SparkPigRecordReader

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable

public class SparkPigRecordReader
extends PigRecordReader

Record reader for Spark mode - handles SparkPigSplit

Constructor Summary

Constructors

Constructor and Description
SparkPigRecordReader(org.apache.hadoop.mapreduce.InputFormat<?,?> inputformat, PigSplit pigSplit, LoadFuncDecorator decorator, org.apache.hadoop.mapreduce.TaskAttemptContext context, long limit)

Method Summary

Modifier and Type	Method and Description
void	initialize(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)

Methods inherited from class org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader

close, getCurrentKey, getCurrentValue, getProgress, initNextRecordReader, nextKeyValue

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkPigRecordReader

public SparkPigRecordReader(org.apache.hadoop.mapreduce.InputFormat<?,?> inputformat,
                            PigSplit pigSplit,
                            LoadFuncDecorator decorator,
                            org.apache.hadoop.mapreduce.TaskAttemptContext context,
                            long limit)
                     throws java.io.IOException,
                            java.lang.InterruptedException

Parameters:

inputformat -

pigSplit -

loadFunc -

context -

limit -

Throws:

java.io.IOException

java.lang.InterruptedException

Method Detail

initialize

public void initialize(org.apache.hadoop.mapreduce.InputSplit split,
                       org.apache.hadoop.mapreduce.TaskAttemptContext context)
                throws java.io.IOException,
                       java.lang.InterruptedException

Overrides:

initialize in class PigRecordReader

Throws:

java.io.IOException

java.lang.InterruptedException