Package | Description |
---|---|
org.apache.pig |
Public interfaces and classes for Pig.
|
org.apache.pig.backend.executionengine | |
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer |
Implementation of physical operators that use hadoop as the execution engine
and data storage.
|
org.apache.pig.builtin |
This package contains builtin Pig UDFs.
|
org.apache.pig.data |
This package contains implementations of Pig specific data types as well as
support functions for reading, writing, and using all Pig data types.
|
org.apache.pig.newplan.logical.relational | |
org.apache.pig.tools.pigstats | |
org.apache.pig.tools.pigstats.mapreduce | |
org.apache.pig.tools.pigstats.tez |
Modifier and Type | Interface and Description |
---|---|
interface |
Accumulator<T>
An interface that allows UDFs that take a bag to accumulate tuples in chunks rather than take
the whole set at once.
|
interface |
Algebraic
An interface to declare that an EvalFunc's
calculation can be decomposed into intitial, intermediate, and final steps.
|
interface |
CollectableLoadFunc
This interface implemented by a
LoadFunc implementations indicates to
Pig that it has the capability to load data such that all instances of a key
will occur in same split. |
class |
ComparisonFunc
Deprecated.
|
class |
EvalFunc<T>
The class is used to implement functions to be applied to
fields in a dataset.
|
interface |
ExecType
The type of query execution.
|
class |
Expression
A class to communicate Filter expressions to LoadFuncs.
|
class |
FileInputLoadFunc
This class provides an implementation of OrderedLoadFunc interface
which can be optionally re-used by LoadFuncs that use FileInputFormat, by
having this as a super class
|
class |
FileSplitComparable
This class represents a relative position in a file.
|
class |
FilterFunc |
class |
FuncSpec
Class to represent a UDF specification.
|
interface |
IndexableLoadFunc
This class is intended for use by LoadFunc implementations
which have an internal index for sorted data and can use the index
to support merge join in Pig.
|
class |
IteratingAccumulatorEvalFunc<T>
This class provides a much more intuitive way to write Accumulator UDFs.
For example, you could express IsEmpty as follows: |
class |
JVMReuseManager
This class is used to manage JVM Reuse in case of execution engines like Tez
and Spark.
|
interface |
LoadCaster
An interface that provides cast implementations for load functions.
|
class |
LoadFunc
A LoadFunc loads data into Pig.
|
interface |
LoadMetadata
This interface defines how to retrieve metadata related to data to be loaded.
|
interface |
LoadPushDown
This interface defines how to communicate to Pig what functionality can
be pushed into the loader.
|
static class |
LoadPushDown.RequiredField
Describes a field that is required to execute a scripts.
|
static class |
LoadPushDown.RequiredFieldList
List of fields that Pig knows to be required to executed a script.
|
static class |
LoadPushDown.RequiredFieldResponse
Indicates whether the loader will return the requested fields or all fields.
|
interface |
LoadStoreCaster
This is just a union interface of LoadCaster and StoreCaster,
made available for simplicity.
|
interface |
OrderedLoadFunc
Implementing this interface indicates to Pig that a given loader
can be used for MergeJoin.
|
class |
PigConstants |
class |
PigRunner
A utility to help run PIG scripts within a Java program.
|
class |
PigServer
A class for Java programs to connect to Pig.
|
class |
PigStreamingBase
The interface is used for the custom mapping of
- a
Tuple to a byte array. |
interface |
PigToStream
Deprecated.
Use
PigStreamingBase |
class |
ResourceSchema
A represenation of a schema used to communicate with load and store functions.
|
class |
ResourceStatistics
An class that represents statistics about data to be loaded or stored.
|
interface |
StoreCaster
An interface that provides methods for converting Pig internal types to byte[].
|
class |
StoreFunc
StoreFuncs take records from Pig's processing and store them into a data store.
|
interface |
StoreFuncInterface
StoreFuncs take records from Pig's processing and store them into a data store.
|
interface |
StoreMetadata
This interface defines how to write metadata related to data to be stored.
|
interface |
StoreResources
This interface allow StoreFunc to specify resources needed
in distributed cache.
|
interface |
StreamToPig
Deprecated.
Use
PigStreamingBase |
Modifier and Type | Interface and Description |
---|---|
interface |
ExecutionEngine
The main interface bridging the front end and back end of Pig.
|
Modifier and Type | Interface and Description |
---|---|
interface |
PigReducerEstimator
Interface to implement when you want to use a custom approach to estimating
the number of reducers for a job.
|
interface |
PigStatsOutputSizeReader
Interface to implement when you want to customize the way of computing the
size of output in PigStats.
|
Modifier and Type | Interface and Description |
---|---|
interface |
PigProgressable
Pig's progress indicator.
|
Modifier and Type | Class and Description |
---|---|
interface |
MonitoredUDF
Describes how the execution of a UDF should be monitored, and what
to do if it times out.
|
interface |
Nondeterministic
A non-deterministic UDF is one that can produce different results when
invoked on the same input.
|
interface |
OutputSchema
An EvalFunc can annotated with an
OutputSchema to
tell Pig what the expected output is. |
Modifier and Type | Class and Description |
---|---|
class |
AppendableSchemaTuple<T extends AppendableSchemaTuple<T>> |
class |
BagFactory
Factory for constructing different types of bags.
|
interface |
DataBag
A collection of Tuples.
|
class |
DataByteArray
An implementation of byte array.
|
class |
DataType
A class of static final values used to encode data type and a number of
static helper functions for manipulating data objects.
|
class |
SchemaTuple<T extends SchemaTuple<T>>
A SchemaTuple is a type aware tuple that is much faster and more memory efficient.
|
interface |
Tuple
An ordered list of Data.
|
class |
TupleFactory
A factory to construct tuples.
|
interface |
TupleRawComparator
This interface is intended to compare Tuples.
|
Modifier and Type | Class and Description |
---|---|
class |
LogicalPlanData
This class provides information regarding the LogicalPlan.
|
Modifier and Type | Class and Description |
---|---|
class |
InputStats
This class encapsulates the runtime statistics of a user specified input.
|
class |
JobStats
This class encapsulates the runtime statistics of a MapReduce job.
|
class |
OutputStats
This class encapsulates the runtime statistics of an user specified output.
|
interface |
PigProgressNotificationListener
Should be implemented by an object that wants to receive notifications
from
PigRunner . |
class |
PigStats
PigStats encapsulates the statistics collected from a running script.
|
class |
PigStatusReporter |
Modifier and Type | Class and Description |
---|---|
class |
MRJobStats
This class encapsulates the runtime statistics of a MapReduce job.
|
Modifier and Type | Class and Description |
---|---|
class |
PigTezProgressNotificationListener
Should be implemented by an object that wants to receive notifications
from
PigRunner . |
Copyright © 2007-2017 The Apache Software Foundation