org.apache.pig.data

Class SelfSpillBag

java.lang.Object

org.apache.pig.data.DefaultAbstractBag

org.apache.pig.data.SelfSpillBag

All Implemented Interfaces:

Serializable, Comparable, Iterable<Tuple>, org.apache.hadoop.io.Writable, org.apache.hadoop.io.WritableComparable, DataBag, Spillable

Direct Known Subclasses:

InternalCachedBag, SortedSpillBag

@InterfaceAudience.Private
 @InterfaceStability.Evolving
public abstract class SelfSpillBag
extends DefaultAbstractBag

Class to hold code common to self spilling bags such as InternalCachedBag

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	SelfSpillBag.MemoryLimits This class helps to compute the number of entries that should be held in memory so that memory consumption is limited.

Nested classes/interfaces inherited from class org.apache.pig.data.DefaultAbstractBag

DefaultAbstractBag.BagDelimiterTuple, DefaultAbstractBag.EndBag, DefaultAbstractBag.StartBag

Field Summary

Fields

Modifier and Type	Field and Description
protected SelfSpillBag.MemoryLimits	memLimit

Fields inherited from class org.apache.pig.data.DefaultAbstractBag

endBag, MAX_SPILL_FILES, mContents, mSize, mSpillFiles, startBag

Constructor Summary

Constructors

Constructor and Description
SelfSpillBag(int bagCount)
SelfSpillBag(int bagCount, float percent)

Method Summary

Methods inherited from class org.apache.pig.data.DefaultAbstractBag

add, addAll, addAll, addAll, clear, compareTo, equals, getMemorySize, getSpillFile, hashCode, incSpillCount, incSpillCount, markSpillableIfNecessary, markStale, readFields, reportProgress, sampleContents, size, toString, warn, write

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.pig.data.DataBag

isDistinct, isSorted, iterator

Methods inherited from interface org.apache.pig.impl.util.Spillable

spill

Methods inherited from interface java.lang.Iterable

forEach, spliterator

Field Detail

memLimit

protected SelfSpillBag.MemoryLimits memLimit

Constructor Detail

SelfSpillBag

public SelfSpillBag(int bagCount)

SelfSpillBag

public SelfSpillBag(int bagCount,
                    float percent)