org.apache.pig.builtin

Class RoundRobinPartitioner

java.lang.Object

org.apache.hadoop.mapreduce.Partitioner<org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable>

org.apache.pig.builtin.RoundRobinPartitioner

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable

public class RoundRobinPartitioner
extends org.apache.hadoop.mapreduce.Partitioner<org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable>
implements org.apache.hadoop.conf.Configurable

Field Summary

Fields

Modifier and Type	Field and Description
static String	PIG_ROUND_ROBIN_PARTITIONER_BATCH_SIZE Batch size for round robin partitioning.

Constructor Summary

Constructors

Constructor and Description
RoundRobinPartitioner()

Method Summary

Methods

Modifier and Type	Method and Description
org.apache.hadoop.conf.Configuration	getConf()
int	getPartition(org.apache.hadoop.io.Writable key, org.apache.hadoop.io.Writable value, int numPartitions)
void	setConf(org.apache.hadoop.conf.Configuration conf)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PIG_ROUND_ROBIN_PARTITIONER_BATCH_SIZE

public static String PIG_ROUND_ROBIN_PARTITIONER_BATCH_SIZE

Batch size for round robin partitioning. Batch size number of records will be distributed to each partition in a round robin fashion. Default value is 0 which distributes each record in a circular fashion. Higher number for batch size can be used to increase probability of keeping similar records in the same partition if output is already sorted and get better compression.

Constructor Detail

RoundRobinPartitioner

public RoundRobinPartitioner()

Method Detail

getPartition

public int getPartition(org.apache.hadoop.io.Writable key,
               org.apache.hadoop.io.Writable value,
               int numPartitions)

Specified by:

getPartition in class org.apache.hadoop.mapreduce.Partitioner<org.apache.hadoop.io.Writable,org.apache.hadoop.io.Writable>

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

getConf

public org.apache.hadoop.conf.Configuration getConf()

Specified by:

getConf in interface org.apache.hadoop.conf.Configurable