org.apache.pig.piggybank.storage.avro

Class PigAvroDatumReader

java.lang.Object

org.apache.avro.generic.GenericDatumReader<java.lang.Object>

org.apache.pig.piggybank.storage.avro.PigAvroDatumReader

All Implemented Interfaces:

org.apache.avro.io.DatumReader<java.lang.Object>

public class PigAvroDatumReader
extends org.apache.avro.generic.GenericDatumReader<java.lang.Object>

An avro GenericDatumReader which reads in avro data and converts them to pig data: tuples, bags, etc.

Constructor Summary

Constructors

Constructor and Description
PigAvroDatumReader(org.apache.avro.Schema schema) Construct where the writer's and reader's schemas are the same.
PigAvroDatumReader(org.apache.avro.Schema writer, org.apache.avro.Schema reader) Construct given writer's and reader's schema.

Method Summary

Methods

Modifier and Type	Method and Description
protected void	addToArray(java.lang.Object array, long pos, java.lang.Object e) Called by the default implementation of GenericDatumReader.readArray(java.lang.Object, org.apache.avro.Schema, org.apache.avro.io.ResolvingDecoder) to add a value.
protected java.lang.Object	createEnum(java.lang.String symbol, org.apache.avro.Schema schema) Called to create an enum value.
protected java.lang.Object	newArray(java.lang.Object old, int size, org.apache.avro.Schema schema) Called to create new array instances.
protected java.lang.Object	newRecord(java.lang.Object old, org.apache.avro.Schema schema) Called to create new record instances.
protected java.lang.Object	peekArray(java.lang.Object array) Called by the default implementation of GenericDatumReader.readArray(java.lang.Object, org.apache.avro.Schema, org.apache.avro.io.ResolvingDecoder) to retrieve a value from a reused instance.
protected java.lang.Object	readBytes(java.lang.Object old, org.apache.avro.io.Decoder in) Called to read byte arrays.
protected java.lang.Object	readFixed(java.lang.Object old, org.apache.avro.Schema expected, org.apache.avro.io.Decoder in) Called to read a fixed value.
protected java.lang.Object	readMap(java.lang.Object old, org.apache.avro.Schema expected, org.apache.avro.io.ResolvingDecoder in) Called to read a map instance.
protected java.lang.Object	readRecord(java.lang.Object old, org.apache.avro.Schema expected, org.apache.avro.io.ResolvingDecoder in) Called to read a record instance.
protected java.lang.Object	readString(java.lang.Object old, org.apache.avro.Schema expected, org.apache.avro.io.Decoder in) Called to read strings.

Methods inherited from class org.apache.avro.generic.GenericDatumReader

addToMap, createBytes, createFixed, createFixed, createString, findStringClass, getData, getExpected, getResolver, getSchema, newInstanceFromString, newMap, read, read, readArray, readBytes, readEnum, readField, readInt, readMapKey, readString, setExpected, setSchema, skip

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PigAvroDatumReader

public PigAvroDatumReader(org.apache.avro.Schema schema)

Construct where the writer's and reader's schemas are the same.

PigAvroDatumReader

public PigAvroDatumReader(org.apache.avro.Schema writer,
                  org.apache.avro.Schema reader)
                   throws java.io.IOException

Construct given writer's and reader's schema.

Throws:

java.io.IOException

Method Detail

readRecord

protected java.lang.Object readRecord(java.lang.Object old,
                          org.apache.avro.Schema expected,
                          org.apache.avro.io.ResolvingDecoder in)
                               throws java.io.IOException

Called to read a record instance. Overridden to read a pig tuple.

Overrides:

readRecord in class org.apache.avro.generic.GenericDatumReader<java.lang.Object>

Throws:

java.io.IOException

readMap

protected java.lang.Object readMap(java.lang.Object old,
                       org.apache.avro.Schema expected,
                       org.apache.avro.io.ResolvingDecoder in)
                            throws java.io.IOException

Called to read a map instance. Overridden to read a pig map.

Overrides:

readMap in class org.apache.avro.generic.GenericDatumReader<java.lang.Object>

Throws:

java.io.IOException

createEnum

protected java.lang.Object createEnum(java.lang.String symbol,
                          org.apache.avro.Schema schema)

Called to create an enum value. Overridden to create a pig string.

Overrides:

createEnum in class org.apache.avro.generic.GenericDatumReader<java.lang.Object>

peekArray

protected java.lang.Object peekArray(java.lang.Object array)

Called by the default implementation of GenericDatumReader.readArray(java.lang.Object, org.apache.avro.Schema, org.apache.avro.io.ResolvingDecoder) to retrieve a value from a reused instance.

Overrides:

peekArray in class org.apache.avro.generic.GenericDatumReader<java.lang.Object>

addToArray

protected void addToArray(java.lang.Object array,
              long pos,
              java.lang.Object e)

Called by the default implementation of GenericDatumReader.readArray(java.lang.Object, org.apache.avro.Schema, org.apache.avro.io.ResolvingDecoder) to add a value. Overridden to append to pig bag.

Overrides:

addToArray in class org.apache.avro.generic.GenericDatumReader<java.lang.Object>

readFixed

protected java.lang.Object readFixed(java.lang.Object old,
                         org.apache.avro.Schema expected,
                         org.apache.avro.io.Decoder in)
                              throws java.io.IOException

Called to read a fixed value. Overridden to read a pig byte array.

Overrides:

readFixed in class org.apache.avro.generic.GenericDatumReader<java.lang.Object>

Throws:

java.io.IOException

newRecord

protected java.lang.Object newRecord(java.lang.Object old,
                         org.apache.avro.Schema schema)

Called to create new record instances. Overridden to return a new tuple.

Overrides:

newRecord in class org.apache.avro.generic.GenericDatumReader<java.lang.Object>

newArray

protected java.lang.Object newArray(java.lang.Object old,
                        int size,
                        org.apache.avro.Schema schema)

Called to create new array instances. Overridden to return a new bag.

Overrides:

newArray in class org.apache.avro.generic.GenericDatumReader<java.lang.Object>

readString

protected java.lang.Object readString(java.lang.Object old,
                          org.apache.avro.Schema expected,
                          org.apache.avro.io.Decoder in)
                               throws java.io.IOException

Called to read strings. Overridden to return a pig string.

Overrides:

readString in class org.apache.avro.generic.GenericDatumReader<java.lang.Object>

Throws:

java.io.IOException

readBytes

protected java.lang.Object readBytes(java.lang.Object old,
                         org.apache.avro.io.Decoder in)
                              throws java.io.IOException

Called to read byte arrays. Overridden to return a pig byte array.

Overrides:

readBytes in class org.apache.avro.generic.GenericDatumReader<java.lang.Object>

Throws:

java.io.IOException