Package | Description |
---|---|
org.apache.pig |
Public interfaces and classes for Pig.
|
org.apache.pig.backend.hadoop.accumulo | |
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators | |
org.apache.pig.backend.hadoop.executionengine.tez.plan.operator | |
org.apache.pig.backend.hadoop.hbase | |
org.apache.pig.builtin |
This package contains builtin Pig UDFs.
|
org.apache.pig.builtin.mock | |
org.apache.pig.impl.builtin | |
org.apache.pig.impl.io | |
org.apache.pig.impl.util | |
org.apache.pig.newplan.logical.relational |
Modifier and Type | Class and Description |
---|---|
class |
FileInputLoadFunc
This class provides an implementation of OrderedLoadFunc interface
which can be optionally re-used by LoadFuncs that use FileInputFormat, by
having this as a super class
|
class |
LoadFuncMetadataWrapper
Convenience class to extend when decorating a class that extends LoadFunc and
implements LoadMetadata.
|
class |
LoadFuncWrapper
Convenience class to extend when decorating a LoadFunc.
|
Modifier and Type | Method and Description |
---|---|
protected LoadFunc |
LoadFuncWrapper.loadFunc() |
Modifier and Type | Method and Description |
---|---|
protected void |
LoadFuncWrapper.setLoadFunc(LoadFunc loadFunc)
The wrapped LoadFunc object must be set before method calls are made on this object.
|
Modifier and Type | Class and Description |
---|---|
class |
AbstractAccumuloStorage
A LoadStoreFunc for retrieving data from and storing data to Accumulo
A Key/Val pair will be returned as tuples: (key, colfam, colqual, colvis,
timestamp, value).
|
class |
AccumuloStorage
Basic PigStorage implementation that uses Accumulo as the backing store.
|
Modifier and Type | Class and Description |
---|---|
class |
MergeJoinIndexer
Merge Join indexer is used to generate on the fly index for doing Merge Join efficiently.
|
Modifier and Type | Field and Description |
---|---|
protected LoadFunc |
POMergeJoin.rightLoader |
Modifier and Type | Method and Description |
---|---|
LoadFunc |
LoadFuncDecorator.getLoader() |
LoadFunc |
POLoad.getLoadFunc() |
protected LoadFunc |
POMergeJoinTez.getRightLoader() |
protected LoadFunc |
POMergeJoin.getRightLoader()
Instantiate right loader
|
Constructor and Description |
---|
LoadFuncDecorator(LoadFunc loader,
java.lang.String udfSignature) |
POLoad(OperatorKey k,
LoadFunc lf) |
Constructor and Description |
---|
POSimpleTezLoad(OperatorKey k,
LoadFunc loader) |
Modifier and Type | Class and Description |
---|---|
class |
HBaseStorage
A HBase implementation of LoadFunc and StoreFunc.
|
Modifier and Type | Class and Description |
---|---|
class |
AvroStorage
Pig UDF for reading and writing Avro data.
|
class |
BinStorage
Load and store data in a binary format.
|
class |
JsonLoader
A loader for data stored using
JsonStorage . |
class |
OrcStorage
A load function and store function for ORC file.
|
class |
ParquetLoader
Wrapper class which will delegate calls to parquet.pig.ParquetLoader
|
class |
PigStorage
A load function that parses a line of input into fields using a character delimiter.
|
class |
TextLoader
This load function simply creates a tuple for each line of text that has a
single chararray field that
contains the line of text.
|
class |
TrevniStorage
Pig Store/Load Function for Trevni.
|
Modifier and Type | Class and Description |
---|---|
class |
Storage
A convenient mock Storage for unit tests
|
Modifier and Type | Class and Description |
---|---|
class |
DefaultIndexableLoader
Used by MergeJoin .
|
class |
PoissonSampleLoader
See "Skewed Join sampler" in http://wiki.apache.org/pig/PigSampler
|
class |
RandomSampleLoader
A loader that samples the data.
|
class |
SampleLoader
Abstract class that specifies the interface for sample loaders
|
class |
TezIndexableLoader |
Modifier and Type | Field and Description |
---|---|
protected LoadFunc |
SampleLoader.loader |
Modifier and Type | Class and Description |
---|---|
class |
InterStorage
LOAD FUNCTION FOR PIG INTERNAL USE ONLY!
This load function is used for storing intermediate data between MR jobs of
a pig query.
|
class |
ReadToEndLoader
This is wrapper Loader which wraps a real LoadFunc underneath and allows
to read a file completely starting a given split (indicated by a split index
which is used to look in the List
|
class |
SequenceFileInterStorage
Store tuples (BinSedesTuples, specifically) using sequence files to leverage
sequence file's compression features.
|
class |
TFileStorage
LOAD FUNCTION FOR PIG INTERNAL USE ONLY! This load function is used for
storing intermediate data between MR jobs of a pig query.
|
Modifier and Type | Method and Description |
---|---|
DataBag |
PigFile.load(LoadFunc lfunc,
PigContext pigContext) |
Constructor and Description |
---|
ReadToEndLoader(LoadFunc wrappedLoadFunc,
org.apache.hadoop.conf.Configuration conf,
java.lang.String inputLocation,
int splitIndex) |
ReadToEndLoader(LoadFunc wrappedLoadFunc,
org.apache.hadoop.conf.Configuration conf,
java.lang.String inputLocation,
int[] toReadSplitIdxs)
This constructor takes an array of split indexes (toReadSplitIdxs) of the
splits to be read.
|
ReadToEndLoader(LoadFunc wrappedLoadFunc,
org.apache.hadoop.conf.Configuration conf,
java.lang.String inputLocation,
int splitIndex,
java.lang.String signature) |
Modifier and Type | Method and Description |
---|---|
static ResourceSchema |
Utils.getSchema(LoadFunc wrappedLoadFunc,
java.lang.String location,
boolean checkExistence,
org.apache.hadoop.mapreduce.Job job) |
Modifier and Type | Method and Description |
---|---|
LoadFunc |
LOLoad.getLoadFunc() |
Constructor and Description |
---|
LOLoad(FileSpec loader,
LogicalSchema schema,
LogicalPlan plan,
org.apache.hadoop.conf.Configuration conf,
LoadFunc loadFunc,
java.lang.String signature)
Used from the LogicalPlanBuilder
|
Copyright © 2007-2025 The Apache Software Foundation