Package | Description |
---|---|
org.apache.pig |
Public interfaces and classes for Pig.
|
org.apache.pig.backend.hadoop.accumulo | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators | |
org.apache.pig.backend.hadoop.hbase | |
org.apache.pig.builtin |
This package contains builtin Pig UDFs.
|
org.apache.pig.data |
This package contains implementations of Pig specific data types as well as
support functions for reading, writing, and using all Pig data types.
|
org.apache.pig.impl.util | |
org.apache.pig.impl.util.hive | |
org.apache.pig.piggybank.storage.avro |
Modifier and Type | Method and Description |
---|---|
ResourceSchema.ResourceFieldSchema[] |
ResourceSchema.getFields()
Get field schema for each field
|
ResourceSchema.ResourceFieldSchema |
ResourceSchema.ResourceFieldSchema.setDescription(String description)
Set the description
|
ResourceSchema.ResourceFieldSchema |
ResourceSchema.ResourceFieldSchema.setName(String name)
Set the name of this filed.
|
ResourceSchema.ResourceFieldSchema |
ResourceSchema.ResourceFieldSchema.setSchema(ResourceSchema schema)
Set the schema for this field.
|
ResourceSchema.ResourceFieldSchema |
ResourceSchema.ResourceFieldSchema.setType(byte type)
Set the type of this field
|
Modifier and Type | Method and Description |
---|---|
DataBag |
LoadCaster.bytesToBag(byte[] b,
ResourceSchema.ResourceFieldSchema fieldSchema)
Cast data from bytearray to bag value.
|
Map<String,Object> |
LoadCaster.bytesToMap(byte[] b,
ResourceSchema.ResourceFieldSchema fieldSchema)
Cast data from bytearray to map value.
|
Tuple |
LoadCaster.bytesToTuple(byte[] b,
ResourceSchema.ResourceFieldSchema fieldSchema)
Cast data from bytearray to tuple value.
|
ResourceSchema |
ResourceSchema.setFields(ResourceSchema.ResourceFieldSchema[] fields)
Set all the fields.
|
Modifier and Type | Method and Description |
---|---|
DataBag |
AccumuloBinaryConverter.bytesToBag(byte[] b,
ResourceSchema.ResourceFieldSchema fieldSchema)
NOT IMPLEMENTED
|
Map<String,Object> |
AccumuloBinaryConverter.bytesToMap(byte[] b,
ResourceSchema.ResourceFieldSchema fieldSchema)
NOT IMPLEMENTED
|
Tuple |
AccumuloBinaryConverter.bytesToTuple(byte[] b,
ResourceSchema.ResourceFieldSchema fieldSchema)
NOT IMPLEMENTED
|
protected org.apache.hadoop.io.Text |
AbstractAccumuloStorage.objectToText(Object o,
ResourceSchema.ResourceFieldSchema fieldSchema) |
protected byte |
AbstractAccumuloStorage.schemaToType(Object o,
int i,
ResourceSchema.ResourceFieldSchema[] fieldSchemas) |
protected byte |
AbstractAccumuloStorage.schemaToType(Object o,
ResourceSchema.ResourceFieldSchema fieldSchema) |
protected byte[] |
AbstractAccumuloStorage.tupleToBytes(Tuple tuple,
int i,
ResourceSchema.ResourceFieldSchema[] fieldSchemas) |
protected org.apache.hadoop.io.Text |
AbstractAccumuloStorage.tupleToText(Tuple tuple,
int i,
ResourceSchema.ResourceFieldSchema[] fieldSchemas) |
Modifier and Type | Method and Description |
---|---|
void |
POCast.setFieldSchema(ResourceSchema.ResourceFieldSchema s) |
Modifier and Type | Method and Description |
---|---|
DataBag |
HBaseBinaryConverter.bytesToBag(byte[] b,
ResourceSchema.ResourceFieldSchema fieldSchema)
NOT IMPLEMENTED
|
Map<String,Object> |
HBaseBinaryConverter.bytesToMap(byte[] b,
ResourceSchema.ResourceFieldSchema fieldSchema) |
Tuple |
HBaseBinaryConverter.bytesToTuple(byte[] b,
ResourceSchema.ResourceFieldSchema fieldSchema)
NOT IMPLEMENTED
|
Modifier and Type | Method and Description |
---|---|
DataBag |
Utf8StorageConverter.bytesToBag(byte[] b,
ResourceSchema.ResourceFieldSchema schema) |
DataBag |
TextLoader.bytesToBag(byte[] b,
ResourceSchema.ResourceFieldSchema schema)
TextLoader does not support conversion to Bag
|
Map<String,Object> |
Utf8StorageConverter.bytesToMap(byte[] b,
ResourceSchema.ResourceFieldSchema fieldSchema) |
Map<String,Object> |
TextLoader.bytesToMap(byte[] b,
ResourceSchema.ResourceFieldSchema schema) |
Tuple |
Utf8StorageConverter.bytesToTuple(byte[] b,
ResourceSchema.ResourceFieldSchema fieldSchema) |
Tuple |
TextLoader.bytesToTuple(byte[] b,
ResourceSchema.ResourceFieldSchema schema)
TextLoader does not support conversion to Tuple
|
Modifier and Type | Method and Description |
---|---|
static Schema.FieldSchema |
DataType.determineFieldSchema(ResourceSchema.ResourceFieldSchema rcFieldSchema)
Determine the field schema of an ResourceFieldSchema
|
Modifier and Type | Method and Description |
---|---|
static Object |
CastUtils.convertToType(LoadCaster caster,
byte[] bytes,
ResourceSchema.ResourceFieldSchema fieldSchema,
byte dataType) |
Modifier and Type | Method and Description |
---|---|
static ResourceSchema.ResourceFieldSchema |
HiveUtils.getResourceFieldSchema(org.apache.hadoop.hive.serde2.typeinfo.TypeInfo ti) |
Modifier and Type | Method and Description |
---|---|
static org.apache.hadoop.hive.serde2.typeinfo.TypeInfo |
HiveUtils.getTypeInfo(ResourceSchema.ResourceFieldSchema fs) |
Modifier and Type | Method and Description |
---|---|
static ResourceSchema.ResourceFieldSchema |
AvroSchema2Pig.getPigSchema(byte pigType,
String fieldName)
Wrap a pig type to a field schema
|
static ResourceSchema.ResourceFieldSchema |
AvroStorageUtils.wrapAsTuple(ResourceSchema.ResourceFieldSchema subFieldSchema)
wrap a pig schema as tuple
|
Modifier and Type | Method and Description |
---|---|
protected static void |
AvroSchema2Pig.add2BagSchema(ResourceSchema.ResourceFieldSchema fieldSchema,
ResourceSchema.ResourceFieldSchema subFieldSchema)
Add a field schema to a bag schema
|
protected static org.apache.avro.Schema |
PigSchema2Avro.convert(ResourceSchema.ResourceFieldSchema pigSchema,
boolean nullable)
Convert a Pig ResourceFieldSchema to avro schema
|
protected static org.apache.avro.Schema |
PigSchema2Avro.convertRecord(ResourceSchema.ResourceFieldSchema[] pigFields,
boolean nullable)
Convert pig data to Avro record
|
protected static boolean |
PigSchema2Avro.isCompatible(org.apache.avro.Schema avroSchema,
ResourceSchema.ResourceFieldSchema pigSchema)
Check whether Avro type is compatible with Pig type
|
static boolean |
AvroStorageUtils.isTupleWrapper(ResourceSchema.ResourceFieldSchema pigSchema)
check whether it is just a wrapped tuple
|
protected static org.apache.avro.Schema |
PigSchema2Avro.validateAndConvert(org.apache.avro.Schema avroSchema,
ResourceSchema.ResourceFieldSchema pigSchema)
Validate whether pigSchema is compatible with avroSchema and convert
those Pig fields with to corresponding Avro schemas.
|
protected static org.apache.avro.Schema |
PigSchema2Avro.validateAndConvertRecord(org.apache.avro.Schema avroSchema,
ResourceSchema.ResourceFieldSchema[] pigFields)
Validate a Pig tuple is compatible with Avro record.
|
static ResourceSchema.ResourceFieldSchema |
AvroStorageUtils.wrapAsTuple(ResourceSchema.ResourceFieldSchema subFieldSchema)
wrap a pig schema as tuple
|
Copyright © 2007-2017 The Apache Software Foundation