Package | Description |
---|---|
org.apache.pig |
Public interfaces and classes for Pig.
|
org.apache.pig.backend.executionengine | |
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer |
Implementation of physical operators that use hadoop as the execution engine
and data storage.
|
org.apache.pig.backend.hadoop.executionengine.tez.plan.operator | |
org.apache.pig.data |
This package contains implementations of Pig specific data types as well as
support functions for reading, writing, and using all Pig data types.
|
org.apache.pig.impl.util | |
org.apache.pig.newplan.logical.relational | |
org.apache.pig.newplan.logical.rules | |
org.apache.pig.tools.pigstats | |
org.apache.pig.tools.pigstats.mapreduce | |
org.apache.pig.tools.pigstats.tez | |
org.apache.pig.validator |
Modifier and Type | Interface and Description |
---|---|
interface |
CollectableLoadFunc
This interface implemented by a
LoadFunc implementations indicates to
Pig that it has the capability to load data such that all instances of a key
will occur in same split. |
interface |
ExecType
The type of query execution.
|
class |
Expression
A class to communicate Filter expressions to LoadFuncs.
|
class |
FileInputLoadFunc
This class provides an implementation of OrderedLoadFunc interface
which can be optionally re-used by LoadFuncs that use FileInputFormat, by
having this as a super class
|
class |
FileSplitComparable
This class represents a relative position in a file.
|
interface |
IndexableLoadFunc
This class is intended for use by LoadFunc implementations
which have an internal index for sorted data and can use the index
to support merge join in Pig.
|
interface |
LoadCaster
An interface that provides cast implementations for load functions.
|
interface |
LoadMetadata
This interface defines how to retrieve metadata related to data to be loaded.
|
interface |
LoadPredicatePushdown
This interface defines how a loader can support predicate pushdown.
|
interface |
LoadPushDown
This interface defines how to communicate to Pig what functionality can
be pushed into the loader.
|
static class |
LoadPushDown.RequiredField
Describes a field that is required to execute a scripts.
|
static class |
LoadPushDown.RequiredFieldList
List of fields that Pig knows to be required to executed a script.
|
static class |
LoadPushDown.RequiredFieldResponse
Indicates whether the loader will return the requested fields or all fields.
|
interface |
LoadStoreCaster
This is just a union interface of LoadCaster and StoreCaster,
made available for simplicity.
|
interface |
OrderedLoadFunc
Implementing this interface indicates to Pig that a given loader
can be used for MergeJoin.
|
class |
PigRunner
A utility to help run PIG scripts within a Java program.
|
interface |
StoreCaster
An interface that provides methods for converting Pig internal types to byte[].
|
interface |
StoreMetadata
This interface defines how to write metadata related to data to be stored.
|
interface |
StoreResources
This interface allow StoreFunc to specify resources needed
in distributed cache.
|
Modifier and Type | Interface and Description |
---|---|
interface |
ExecutionEngine
The main interface bridging the front end and back end of Pig.
|
Modifier and Type | Interface and Description |
---|---|
interface |
PigReducerEstimator
Interface to implement when you want to use a custom approach to estimating
the number of reducers for a job.
|
interface |
PigStatsOutputSizeReader
Interface to implement when you want to customize the way of computing the
size of output in PigStats.
|
Modifier and Type | Interface and Description |
---|---|
interface |
PigLogger
An interface to allow aggregation of messages
|
Modifier and Type | Class and Description |
---|---|
class |
POBloomFilterRearrangeTez |
class |
POBuildBloomRearrangeTez
This operator writes out the key value for the hash join reduce operation similar to POLocalRearrangeTez.
|
Modifier and Type | Class and Description |
---|---|
class |
InternalCachedBag |
class |
InternalDistinctBag
An unordered collection of Tuples with no multiples.
|
interface |
InterSedes
A class to handle reading and writing of intermediate results of data
types.
|
class |
InterSedesFactory
Used to get hold of the single instance of InterSedes .
|
class |
SelfSpillBag
Class to hold code common to self spilling bags such as InternalCachedBag
|
static class |
SelfSpillBag.MemoryLimits
This class helps to compute the number of entries that should be held in
memory so that memory consumption is limited.
|
class |
SizeUtil
Utility functions for estimating size of objects of pig types
|
class |
SortedSpillBag
Common functionality for proactively spilling bags that need to keep the data
sorted.
|
interface |
TupleRawComparator
This interface is intended to compare Tuples.
|
Modifier and Type | Interface and Description |
---|---|
interface |
GroupingSpillable
Interface to be implemented by classes that group data in memory
|
Modifier and Type | Class and Description |
---|---|
class |
LogicalPlanData
This class provides information regarding the LogicalPlan.
|
Modifier and Type | Interface and Description |
---|---|
interface |
LogicalRelationalNodeValidator
Implementors of this interface would define validations based on logical
operators within a Pig script.
|
Modifier and Type | Class and Description |
---|---|
class |
InputStats
This class encapsulates the runtime statistics of a user specified input.
|
class |
JobStats
This class encapsulates the runtime statistics of a MapReduce job.
|
class |
OutputStats
This class encapsulates the runtime statistics of an user specified output.
|
interface |
PigProgressNotificationListener
Should be implemented by an object that wants to receive notifications
from
PigRunner . |
class |
PigStats
PigStats encapsulates the statistics collected from a running script.
|
class |
PigStatusReporter |
Modifier and Type | Class and Description |
---|---|
class |
MRJobStats
This class encapsulates the runtime statistics of a MapReduce job.
|
Modifier and Type | Class and Description |
---|---|
class |
PigTezProgressNotificationListener
Should be implemented by an object that wants to receive notifications
from
PigRunner . |
Modifier and Type | Interface and Description |
---|---|
interface |
PigCommandFilter
Interface defining Pig commands and a
PigCommandFilter.validate(Command) method to operate on it |
Copyright © 2007-2017 The Apache Software Foundation