org.apache.pig

Interface StoreMetadata

All Known Implementing Classes:

AllLoader, CSVExcelStorage, HiveColumnarStorage, IndexedStorage, JsonMetadata, JsonMetadata, JsonStorage, ParquetStorer, PigStorage, PigStorageSchema, Storage, StoreFuncMetadataWrapper

@InterfaceAudience.Public
@InterfaceStability.Evolving
public interface StoreMetadata

This interface defines how to write metadata related to data to be stored. If a given store function does not implement this interface, it will be assumed that it is unable to record metadata about the associated data.

Method Summary

Methods

Modifier and Type	Method and Description
void	storeSchema(ResourceSchema schema, java.lang.String location, org.apache.hadoop.mapreduce.Job job) Store schema of the data being written
void	storeStatistics(ResourceStatistics stats, java.lang.String location, org.apache.hadoop.mapreduce.Job job) Store statistics about the data being written.

Method Detail

storeStatistics

void storeStatistics(ResourceStatistics stats,
                   java.lang.String location,
                   org.apache.hadoop.mapreduce.Job job)
                     throws java.io.IOException

Store statistics about the data being written.

Parameters:

stats - statistics to be recorded

location - Location as returned by LoadFunc.relativeToAbsolutePath(String, org.apache.hadoop.fs.Path)

job - The Job object - this should be used only to obtain cluster properties through JobContext.getConfiguration() and not to set/query any runtime job information.

Throws:

java.io.IOException

storeSchema

void storeSchema(ResourceSchema schema,
               java.lang.String location,
               org.apache.hadoop.mapreduce.Job job)
                 throws java.io.IOException

Store schema of the data being written

Parameters:

schema - Schema to be recorded

location - Location as returned by LoadFunc.relativeToAbsolutePath(String, org.apache.hadoop.fs.Path)

job - The Job object - this should be used only to obtain cluster properties through JobContext.getConfiguration() and not to set/query any runtime job information.

Throws:

java.io.IOException