Package | Description |
---|---|
nl.basjes.pig.input.apachehttpdlog | |
org.apache.pig.backend.hadoop.hbase | |
org.apache.pig.builtin |
This package contains builtin Pig UDFs.
|
org.apache.pig.piggybank.storage | |
org.apache.pig.piggybank.storage.apachelog |
Modifier and Type | Class and Description |
---|---|
class |
nl.basjes.pig.input.apachehttpdlog.Loader |
Modifier and Type | Class and Description |
---|---|
class |
HBaseStorage
A HBase implementation of LoadFunc and StoreFunc.
|
Modifier and Type | Class and Description |
---|---|
class |
AvroStorage
Pig UDF for reading and writing Avro data.
|
class |
OrcStorage
A load function and store function for ORC file.
|
class |
ParquetLoader
Wrapper class which will delegate calls to parquet.pig.ParquetLoader
|
class |
PigStorage
A load function that parses a line of input into fields using a character delimiter.
|
class |
TrevniStorage
Pig Store/Load Function for Trevni.
|
Modifier and Type | Class and Description |
---|---|
class |
AllLoader
The AllLoader provides the ability to point pig at a folder that contains
files in multiple formats e.g.
|
class |
CSVExcelStorage
CSV loading and storing with support for multi-line fields,
and escaping of delimiters and double quotes within fields;
uses CSV conventions of Excel 2007.
|
class |
CSVLoader
A load function based on PigStorage that implements part of the CSV "standard"
This loader properly supports double-quoted fields that contain commas and other
double-quotes escaped with backslashes.
|
class |
FixedWidthLoader
A fixed-width file loader.
|
class |
HiveColumnarLoader
Loader for Hive RC Columnar files.
Supports the following types: * Hive Type Pig Type from DataType string CHARARRAY int INTEGER bigint or long LONG float float double DOUBLE boolean BOOLEAN byte BYTE array TUPLE map MAP Partitions The input paths are scanned by the loader for [partition name]=[value] patterns in the subdirectories. If detected these partitions are appended to the table schema. For example if you have the directory structure: |
class |
HiveColumnarStorage |
class |
IndexedStorage
IndexedStorage is a form of PigStorage that supports a
per record seek. |
class |
PigStorageSchema
Deprecated.
Use PigStorage with a -schema option instead
|
Modifier and Type | Class and Description |
---|---|
class |
LogFormatLoader
This is a pig loader that can load Apache HTTPD access logs written in (almost) any
Apache HTTPD LogFormat.
Basic usage: Simply feed the loader your (custom) logformat specification and it will tell you which fields can be extracted from this logformat. For example: |
Copyright © 2007-2017 The Apache Software Foundation