PigConfiguration (Pig 0.17.0 API)

java.lang.Object
- org.apache.pig.PigConfiguration

```
public class PigConfiguration
extends Object
```
Container for static configuration strings, defaults, etc. This is intended just for keys that can be set by users, not for keys that are generally used within pig.

Field Summary

Fields
Modifier and Type	Field and Description
`static String`	`CALLER_ID` Deprecated. use `PIG_LOG_TRACE_ID` instead. Will be removed in Pig 0.18
`static String`	`ENABLE_ATS` Deprecated. use `PIG_ATS_ENABLED` instead. Will be removed in Pig 0.18
`static String`	`INSERT_ENABLED` Deprecated. use `PIG_SCRIPT_INFO_ENABLED` instead. Will be removed in Pig 0.16
`static String`	`MAX_SCRIPT_SIZE` Deprecated. use `PIG_SCRIPT_MAX_SIZE` instead. Will be removed in Pig 0.16
`static String`	`OPT_FETCH` Deprecated. use `PIG_OPT_FETCH` instead. Will be removed in Pig 0.16
`static String`	`PARTAGG_MINREDUCTION` Deprecated. use `PIG_EXEC_MAP_PARTAGG_MINREDUCTION` instead. Will be removed in Pig 0.16
`static String`	`PIG_ACCUMULATIVE_BATCHSIZE`
`static String`	`PIG_ARTIFACTS_DOWNLOAD_LOCATION` This key is used to set the download location when registering an artifact using ivy coordinate
`static String`	`PIG_ATS_ENABLED` Enable ATS for Pig
`static String`	`PIG_AUTO_LOCAL_ENABLED` This key is to turn on auto local mode feature
`static String`	`PIG_AUTO_LOCAL_INPUT_MAXBYTES` Controls the max threshold size to convert jobs to run in local mode
`static String`	`PIG_BLACKLIST` Comma-delimited entries of commands/operators that must be disallowed.
`static String`	`PIG_BLOOMJOIN_HASH_FUNCTIONS` The number of hash functions to be used in bloom computation.
`static String`	`PIG_BLOOMJOIN_HASH_TYPE` The type of hash function to use.
`static String`	`PIG_BLOOMJOIN_NUM_FILTERS` The number of bloom filters that will be created.
`static String`	`PIG_BLOOMJOIN_STRATEGY` Bloom join has two different kind of implementations.
`static String`	`PIG_BLOOMJOIN_VECTORSIZE_BYTES` The size in bytes of the bit vector to be used for the bloom filter.
`static String`	`PIG_BZIP_USE_HADOOP_INPUTFORMAT` Using hadoop's TextInputFormat for reading bzip input instead of using Pig's Bzip2TextInputFormat.
`static String`	`PIG_CACHEDBAG_DISTINCT_TYPE`
`static String`	`PIG_CACHEDBAG_MEMUSAGE` Controls the fraction of total memory that is allowed to be used by cached bags.
`static String`	`PIG_CACHEDBAG_SORT_TYPE`
`static String`	`PIG_CACHEDBAG_TYPE` Configurations for specifying alternate implementations for cached bags.
`static String`	`PIG_COMPRESS_INPUT_SPLITS` This key is used to configure compression for the pig input splits which are not FileSplit.
`static boolean`	`PIG_COMPRESS_INPUT_SPLITS_DEFAULT`
`static String`	`PIG_DATETIME_DEFAULT_TIMEZONE` The timezone to be used by Pig datetime datatype
`static String`	`PIG_DEFAULT_LOAD_FUNC` This key is used to define the default load func.
`static String`	`PIG_DEFAULT_STORE_FUNC` This key is used to define the default store func.
`static String`	`PIG_DELETE_TEMP_FILE` This key is used to define whether to delete intermediate files of Hadoop jobs.
`static String`	`PIG_ENABLE_TEMP_FILE_COMPRESSION` This key is used to define whether to have intermediate file compressed
`static String`	`PIG_ERROR_HANDLING_ENABLED` Boolean value used to enable or disable error handling for storers
`static String`	`PIG_ERROR_HANDLING_MIN_ERROR_RECORDS` Controls the minimum number of errors
`static String`	`PIG_ERROR_HANDLING_THRESHOLD_PERCENT` Set the threshold for percentage of errors
`static String`	`PIG_EXEC_MAP_PARTAGG` Boolean value to enable or disable partial aggregation in map.
`static String`	`PIG_EXEC_MAP_PARTAGG_MINREDUCTION` Controls the minimum reduction in-mapper Partial Aggregation should achieve in order to stay on.
`static String`	`PIG_EXEC_NO_COMBINER` Boolean value to enable or disable use of combiners in MapReduce jobs.
`static String`	`PIG_EXEC_NO_COMBINER_REDUCER` Enable or disable use of combiners in reducer shuffle-merge phase in Tez.
`static String`	`PIG_EXEC_NO_SECONDARY_KEY` This key controls whether secondary sort key is used for optimization in case of nested distinct or sort
`static String`	`PIG_EXEC_REDUCER_ESTIMATOR`
`static String`	`PIG_EXEC_REDUCER_ESTIMATOR_CONSTRUCTOR_ARG_KEY`
`static String`	`PIG_JOIN_REPLICATED_MAX_BYTES` This key used to control the maximum size loaded into the distributed cache when doing fragment-replicated join
`static String`	`PIG_LOG_TRACE_ID` Log tracing id that can be used by upstream clients for tracking respective logs
`static String`	`PIG_MAX_COMBINED_SPLIT_SIZE` Specifies the size, in bytes, of data to be processed by a single map.
`static String`	`PIG_NO_SPLIT_COMBINATION` Whether turns combine split files off.
`static String`	`PIG_NO_TASK_REPORT` This key is used to turns off use of task reports in job statistics.
`static String`	`PIG_OPT_ACCUMULATOR` Boolean value used to enable or disable accumulator optimization.
`static String`	`PIG_OPT_FETCH` Boolean value used to enable or disable fetching without a mapreduce job for DUMP.
`static String`	`PIG_OPT_MULTIQUERY` Boolean value used to enable or disable multiquery optimization.
`static String`	`PIG_OUTPUT_COMMITTER_RECOVERY` This key is used to define whether to support recovery to handle the application master getting restarted.
`static String`	`PIG_OUTPUT_LAZY` This key is used to define whether PigOutputFormat will be wrapped with LazyOutputFormat so that jobs won't write empty part files if no output is generated
`static String`	`PIG_POISSON_SAMPLER_SAMPLE_RATE` For a given mean and a confidence, a sample rate is obtained from a poisson udf
`static String`	`PIG_PRINT_EXEC_PLAN`
`static String`	`PIG_RANDOM_SAMPLER_SAMPLE_SIZE` This key used to control the sample size of RandomeSampleLoader for order-by.
`static String`	`PIG_SCHEMA_TUPLE_ALLOW_FORCE`
`static String`	`PIG_SCHEMA_TUPLE_ENABLED` This key must be set to true by the user for code generation to be used.
`static String`	`PIG_SCHEMA_TUPLE_USE_IN_FOREACH`
`static String`	`PIG_SCHEMA_TUPLE_USE_IN_FRJOIN`
`static String`	`PIG_SCHEMA_TUPLE_USE_IN_MERGEJOIN`
`static String`	`PIG_SCHEMA_TUPLE_USE_IN_UDF`
`static String`	`PIG_SCRIPT_INFO_ENABLED` This key is used to turn off the inclusion of settings in the jobs.
`static String`	`PIG_SCRIPT_MAX_SIZE` Controls the size of Pig script stored in job xml.
`static String`	`PIG_SKEWEDJOIN_REDUCE_MEM` Memory available (in bytes) in reduce when calculating memory available for skewed join.
`static String`	`PIG_SKEWEDJOIN_REDUCE_MEMUSAGE` % of memory available for the input data.
`static String`	`PIG_SORT_READONCE_LOADFUNCS` Pig only reads once from datasource for LoadFuncs specified here during sort instead of loading once for sampling and loading again for partitioning.
`static String`	`PIG_SPARK_USE_NETTY_FILESERVER` Use Netty file server for Pig on Spark, true or false, default value is false
`static String`	`PIG_SPILL_COLLECTION_THRESHOLD_FRACTION` Spill will be triggered if the fraction of biggest heap exceeds the collection threshold.
`static String`	`PIG_SPILL_MEMORY_USAGE_THRESHOLD_FRACTION` Spill will be triggered if the fraction of biggest heap exceeds the usage threshold.
`static String`	`PIG_SPILL_UNUSED_MEMORY_THRESHOLD_SIZE` Spill will be triggered when unused memory falls below the threshold.
`static String`	`PIG_SPLIT_COMBINATION` Turns combine split files on or off
`static String`	`PIG_STORE_SCHEMA_DISAMBIGUATE` If set to false, automatic schema disambiguation gets disabled i.e.
`static String`	`PIG_STORE_SCHEMA_DISAMBIGUATE_DEFAULT`
`static String`	`PIG_STREAMING_ENVIRONMENT` This key can be used to defined what properties will be set in the streaming environment.
`static String`	`PIG_STREAMING_UDF_PYTHON_COMMAND` This key can be used to configure the python command for python streaming udf.
`static String`	`PIG_TEMP_DIR` Location where pig stores temporary files for job setup
`static String`	`PIG_TEMP_FILE_COMPRESSION_CODEC` Compression codec used by intermediate storage TFileStorage only support gzip and lzo.
`static String`	`PIG_TEMP_FILE_COMPRESSION_STORAGE` This key is used to set the storage type used by intermediate file storage If pig.tmpfilecompression, default storage used is TFileStorage.
`static String`	`PIG_TEZ_AUTO_PARALLELISM` This key is used to configure auto parallelism in tez.
`static String`	`PIG_TEZ_AUTO_PARALLELISM_DISABLE_DAG_RECOVERY` This key is used to turn off dag recovery if there is auto parallelism.
`static String`	`PIG_TEZ_CONFIGURE_AM_MEMORY` If set, Pig will override tez.am.launch.cmd-opts and tez.am.resource.memory.mb to optimal
`static String`	`PIG_TEZ_DAG_STATUS_REPORT_INTERVAL` This key is used to configure the interval of dag status report in seconds.
`static String`	`PIG_TEZ_GRACE_PARALLELISM` This key is used to configure grace parallelism in tez.
`static String`	`PIG_TEZ_INPUT_SPLITS_MEM_THRESHOLD` Serialize input splits to disk if the input splits size exceeds a threshold to avoid hitting default RPC transfer size limit of 64MB.
`static int`	`PIG_TEZ_INPUT_SPLITS_MEM_THRESHOLD_DEFAULT`
`static String`	`PIG_TEZ_OPT_UNION` This key is used to enable or disable union optimization in tez.
`static String`	`PIG_TEZ_OPT_UNION_SUPPORTED_STOREFUNCS` These keys are used to enable or disable tez union optimization for specific StoreFuncs.
`static String`	`PIG_TEZ_OPT_UNION_UNSUPPORTED_STOREFUNCS`
`static String`	`PIG_TEZ_SESSION_REUSE` This key is used to define whether to reuse AM in Tez jobs.
`static String`	`PIG_UDF_PROFILE` Controls whether execution time of Pig UDFs should be tracked.
`static String`	`PIG_UDF_PROFILE_FREQUENCY`
`static String`	`PIG_USER_CACHE_ENABLED` This key is turn on the user level cache
`static String`	`PIG_USER_CACHE_LOCATION` Location where additional jars are cached for the user Additional jar will be cached under PIG_USER_CACHE_LOCATION/${user.name}/.pigcache and will be re-used across the jobs run by the user if the jar has not changed
`static String`	`PIG_USER_CACHE_REPLICATION` Replication factor for files in pig jar cache
`static String`	`PIG_WHITELIST` Comma-delimited entries of commands/operators that must be allowed.
`static String`	`PROP_CACHEDBAG_MEMUSAGE` Deprecated. use `PIG_CACHEDBAG_MEMUSAGE` instead. Will be removed in Pig 0.16
`static String`	`PROP_EXEC_MAP_PARTAGG` Deprecated. use `PIG_EXEC_MAP_PARTAGG` instead. Will be removed in Pig 0.16
`static String`	`PROP_NO_COMBINER` Deprecated. use `#PROP_NO_COMBINER1` instead. Will be removed in Pig 0.16
`static String`	`SCHEMA_TUPLE_SHOULD_ALLOW_FORCE` Deprecated.
`static String`	`SCHEMA_TUPLE_SHOULD_USE_IN_FOREACH` Deprecated.
`static String`	`SCHEMA_TUPLE_SHOULD_USE_IN_FRJOIN` Deprecated.
`static String`	`SCHEMA_TUPLE_SHOULD_USE_IN_MERGEJOIN` Deprecated.
`static String`	`SCHEMA_TUPLE_SHOULD_USE_IN_UDF` Deprecated.
`static String`	`SHOULD_USE_SCHEMA_TUPLE` Deprecated.

Method Summary
- Methods inherited from class java.lang.Object
  clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Field Detail
  - PIG_AUTO_LOCAL_ENABLED
```
public static final String PIG_AUTO_LOCAL_ENABLED
```
    This key is to turn on auto local mode feature
    
    See Also:
    
    Constant Field Values
  - PIG_AUTO_LOCAL_INPUT_MAXBYTES
```
public static final String PIG_AUTO_LOCAL_INPUT_MAXBYTES
```
    Controls the max threshold size to convert jobs to run in local mode
    
    See Also:
    
    Constant Field Values
  - PIG_OPT_FETCH
```
public static final String PIG_OPT_FETCH
```
    Boolean value used to enable or disable fetching without a mapreduce job for DUMP. True by default
    
    See Also:
    
    Constant Field Values
  - PIG_OPT_MULTIQUERY
```
public static final String PIG_OPT_MULTIQUERY
```
    Boolean value used to enable or disable multiquery optimization. True by default
    
    See Also:
    
    Constant Field Values
  - PIG_OPT_ACCUMULATOR
```
public static final String PIG_OPT_ACCUMULATOR
```
    Boolean value used to enable or disable accumulator optimization. True by default
    
    See Also:
    
    Constant Field Values
  - PIG_ACCUMULATIVE_BATCHSIZE
```
public static final String PIG_ACCUMULATIVE_BATCHSIZE
```
    See Also:
    
    Constant Field Values
  - PIG_TEZ_OPT_UNION
```
public static final String PIG_TEZ_OPT_UNION
```
    This key is used to enable or disable union optimization in tez. True by default
    
    See Also:
    
    Constant Field Values
  - PIG_TEZ_OPT_UNION_SUPPORTED_STOREFUNCS
```
public static final String PIG_TEZ_OPT_UNION_SUPPORTED_STOREFUNCS
```
    These keys are used to enable or disable tez union optimization for specific StoreFuncs. Optimization should be turned off for those StoreFuncs that hard code part file names and do not prefix file names with mapreduce.output.basename configuration. If the StoreFuncs implement StoreFunc.supportsParallelWriteToStoreLocation() and return true or false then that is is used to turn on or off union optimization respectively. These settings can be used for StoreFuncs that have not implemented the API yet.
    
    See Also:
    
    Constant Field Values
  - PIG_TEZ_OPT_UNION_UNSUPPORTED_STOREFUNCS
```
public static final String PIG_TEZ_OPT_UNION_UNSUPPORTED_STOREFUNCS
```
    See Also:
    
    Constant Field Values
  - PIG_SORT_READONCE_LOADFUNCS
```
public static final String PIG_SORT_READONCE_LOADFUNCS
```
    Pig only reads once from datasource for LoadFuncs specified here during sort instead of loading once for sampling and loading again for partitioning. Used to avoid hitting external non-filesystem datasources like HBase and Accumulo twice. Honored only by Pig on Tez now.
    
    See Also:
    
    Constant Field Values
  - PIG_EXEC_MAP_PARTAGG
```
public static final String PIG_EXEC_MAP_PARTAGG
```
    Boolean value to enable or disable partial aggregation in map. Disabled by default
    
    See Also:
    
    Constant Field Values
  - PIG_EXEC_MAP_PARTAGG_MINREDUCTION
```
public static final String PIG_EXEC_MAP_PARTAGG_MINREDUCTION
```
    Controls the minimum reduction in-mapper Partial Aggregation should achieve in order to stay on. If after a period of observation this reduction is not achieved, in-mapper aggregation will be turned off and a message logged to that effect.
    
    See Also:
    
    Constant Field Values
  - PIG_EXEC_NO_COMBINER
```
public static final String PIG_EXEC_NO_COMBINER
```
    Boolean value to enable or disable use of combiners in MapReduce jobs. Enabled by default
    
    See Also:
    
    Constant Field Values
  - PIG_EXEC_NO_COMBINER_REDUCER
```
public static final String PIG_EXEC_NO_COMBINER_REDUCER
```
    Enable or disable use of combiners in reducer shuffle-merge phase in Tez. Valid values are auto, true or false. Default is auto which turns off combiner if bags are present in the combine plan
    
    See Also:
    
    Constant Field Values
  - PIG_EXEC_NO_SECONDARY_KEY
```
public static final String PIG_EXEC_NO_SECONDARY_KEY
```
    This key controls whether secondary sort key is used for optimization in case of nested distinct or sort
    
    See Also:
    
    Constant Field Values
  - PIG_CACHEDBAG_MEMUSAGE
```
public static final String PIG_CACHEDBAG_MEMUSAGE
```
    Controls the fraction of total memory that is allowed to be used by cached bags. Default is 0.2.
    
    See Also:
    
    Constant Field Values
  - PIG_SKEWEDJOIN_REDUCE_MEMUSAGE
```
public static final String PIG_SKEWEDJOIN_REDUCE_MEMUSAGE
```
    % of memory available for the input data. This is currently equal to the memory available for the skewed join
    
    See Also:
    
    Constant Field Values
  - PIG_SKEWEDJOIN_REDUCE_MEM
```
public static final String PIG_SKEWEDJOIN_REDUCE_MEM
```
    Memory available (in bytes) in reduce when calculating memory available for skewed join. By default, it is set to Runtime.getRuntime().maxMemory(). Override it only for debug purpose
    
    See Also:
    
    Constant Field Values
  - PIG_BLOOMJOIN_STRATEGY
```
public static final String PIG_BLOOMJOIN_STRATEGY
```
    Bloom join has two different kind of implementations.
    - map
      In each map, bloom filters are computed on the join keys partitioned by the hashcode of the key with PIG_BLOOMJOIN_NUM_FILTERS number of partitions. Bloom filters from different maps are then combined in the reducer producing one bloom filter per partition. This is efficient and fast if there are smaller number of maps (<10) and the number of distinct keys are not too high. It can be faster with larger number of maps and even with bigger bloom vector sizes, but the amount of data shuffled to the reducer for aggregation becomes huge making it inefficient.
    - reduce
      Join keys are sent from the map to the reducer partitioned by hashcode of the key with PIG_BLOOMJOIN_NUM_FILTERS number of reducers. One bloom filter is then created per partition. This is efficient for larger datasets with lot of maps or very large PIG_BLOOMJOIN_VECTORSIZE_BYTES. In this case size of keys sent to the reducer is smaller than sending bloom filters to reducer for aggregation making it efficient.
    Default value is map.
    See Also:
    
    Constant Field Values
  - PIG_BLOOMJOIN_NUM_FILTERS
```
public static final String PIG_BLOOMJOIN_NUM_FILTERS
```
    The number of bloom filters that will be created. Default is 1 for map strategy and 11 for reduce strategy.
    
    See Also:
    
    Constant Field Values
  - PIG_BLOOMJOIN_VECTORSIZE_BYTES
```
public static final String PIG_BLOOMJOIN_VECTORSIZE_BYTES
```
    The size in bytes of the bit vector to be used for the bloom filter. A bigger vector size will be needed when the number of distinct keys is higher. Default value is 1048576 (1MB).
    
    See Also:
    
    Constant Field Values
  - PIG_BLOOMJOIN_HASH_TYPE
```
public static final String PIG_BLOOMJOIN_HASH_TYPE
```
    The type of hash function to use. Valid values are jenkins and murmur. Default is murmur.
    
    See Also:
    
    Constant Field Values
  - PIG_BLOOMJOIN_HASH_FUNCTIONS
```
public static final String PIG_BLOOMJOIN_HASH_FUNCTIONS
```
    The number of hash functions to be used in bloom computation. It determines the probability of false positives. Higher the number lower the false positives. Too high a value can increase the cpu time. Default value is 3.
    
    See Also:
    
    Constant Field Values
  - PIG_JOIN_REPLICATED_MAX_BYTES
```
public static final String PIG_JOIN_REPLICATED_MAX_BYTES
```
    This key used to control the maximum size loaded into the distributed cache when doing fragment-replicated join
    
    See Also:
    
    Constant Field Values
  - PIG_CACHEDBAG_TYPE
```
public static final String PIG_CACHEDBAG_TYPE
```
    Configurations for specifying alternate implementations for cached bags. Rarely used
    
    See Also:
    
    Constant Field Values
  - PIG_CACHEDBAG_DISTINCT_TYPE
```
public static final String PIG_CACHEDBAG_DISTINCT_TYPE
```
    See Also:
    
    Constant Field Values
  - PIG_CACHEDBAG_SORT_TYPE
```
public static final String PIG_CACHEDBAG_SORT_TYPE
```
    See Also:
    
    Constant Field Values
  - PIG_EXEC_REDUCER_ESTIMATOR
```
public static final String PIG_EXEC_REDUCER_ESTIMATOR
```
    See Also:
    
    Constant Field Values
  - PIG_EXEC_REDUCER_ESTIMATOR_CONSTRUCTOR_ARG_KEY
```
public static final String PIG_EXEC_REDUCER_ESTIMATOR_CONSTRUCTOR_ARG_KEY
```
    See Also:
    
    Constant Field Values
  - PIG_TEZ_AUTO_PARALLELISM
```
public static final String PIG_TEZ_AUTO_PARALLELISM
```
    This key is used to configure auto parallelism in tez. Default is true.
    
    See Also:
    
    Constant Field Values
  - PIG_TEZ_GRACE_PARALLELISM
```
public static final String PIG_TEZ_GRACE_PARALLELISM
```
    This key is used to configure grace parallelism in tez. Default is true.
    
    See Also:
    
    Constant Field Values
  - PIG_TEZ_AUTO_PARALLELISM_DISABLE_DAG_RECOVERY
```
public static final String PIG_TEZ_AUTO_PARALLELISM_DISABLE_DAG_RECOVERY
```
    This key is used to turn off dag recovery if there is auto parallelism. Default is false. Useful when running with Tez versions before Tez 0.8 which have issues with auto parallelism during DAG recovery.
    
    See Also:
    
    Constant Field Values
  - PIG_COMPRESS_INPUT_SPLITS
```
public static final String PIG_COMPRESS_INPUT_SPLITS
```
    This key is used to configure compression for the pig input splits which are not FileSplit. Default is false
    
    See Also:
    
    Constant Field Values
  - PIG_COMPRESS_INPUT_SPLITS_DEFAULT
```
public static final boolean PIG_COMPRESS_INPUT_SPLITS_DEFAULT
```
    See Also:
    
    Constant Field Values
  - PIG_TEZ_INPUT_SPLITS_MEM_THRESHOLD
```
public static final String PIG_TEZ_INPUT_SPLITS_MEM_THRESHOLD
```
    Serialize input splits to disk if the input splits size exceeds a threshold to avoid hitting default RPC transfer size limit of 64MB. Default is 33554432 (32MB)
    
    See Also:
    
    Constant Field Values
  - PIG_TEZ_INPUT_SPLITS_MEM_THRESHOLD_DEFAULT
```
public static final int PIG_TEZ_INPUT_SPLITS_MEM_THRESHOLD_DEFAULT
```
    See Also:
    
    Constant Field Values
  - PIG_UDF_PROFILE
```
public static final String PIG_UDF_PROFILE
```
    Controls whether execution time of Pig UDFs should be tracked. This feature uses counters; use judiciously.
    
    See Also:
    
    Constant Field Values
  - PIG_UDF_PROFILE_FREQUENCY
```
public static final String PIG_UDF_PROFILE_FREQUENCY
```
    See Also:
    
    Constant Field Values
  - PIG_SCHEMA_TUPLE_ENABLED
```
public static final String PIG_SCHEMA_TUPLE_ENABLED
```
    This key must be set to true by the user for code generation to be used. In the future, it may be turned on by default (at least in certain cases), but for now it is too experimental.
    
    See Also:
    
    Constant Field Values
  - PIG_SCHEMA_TUPLE_USE_IN_UDF
```
public static final String PIG_SCHEMA_TUPLE_USE_IN_UDF
```
    See Also:
    
    Constant Field Values
  - PIG_SCHEMA_TUPLE_USE_IN_FOREACH
```
public static final String PIG_SCHEMA_TUPLE_USE_IN_FOREACH
```
    See Also:
    
    Constant Field Values
  - PIG_SCHEMA_TUPLE_USE_IN_FRJOIN
```
public static final String PIG_SCHEMA_TUPLE_USE_IN_FRJOIN
```
    See Also:
    
    Constant Field Values
  - PIG_SCHEMA_TUPLE_USE_IN_MERGEJOIN
```
public static final String PIG_SCHEMA_TUPLE_USE_IN_MERGEJOIN
```
    See Also:
    
    Constant Field Values
  - PIG_SCHEMA_TUPLE_ALLOW_FORCE
```
public static final String PIG_SCHEMA_TUPLE_ALLOW_FORCE
```
    See Also:
    
    Constant Field Values
  - PIG_STREAMING_ENVIRONMENT
```
public static final String PIG_STREAMING_ENVIRONMENT
```
    This key can be used to defined what properties will be set in the streaming environment. Just set this property to a comma-delimited list of properties to set, and those properties will be set in the environment.
    
    See Also:
    
    Constant Field Values
  - PIG_STREAMING_UDF_PYTHON_COMMAND
```
public static final String PIG_STREAMING_UDF_PYTHON_COMMAND
```
    This key can be used to configure the python command for python streaming udf. For eg, python2.7.
    
    See Also:
    
    Constant Field Values
  - PIG_SPLIT_COMBINATION
```
public static final String PIG_SPLIT_COMBINATION
```
    Turns combine split files on or off
    
    See Also:
    
    Constant Field Values
  - PIG_NO_SPLIT_COMBINATION
```
public static final String PIG_NO_SPLIT_COMBINATION
```
    Whether turns combine split files off. This is for internal use only
    
    See Also:
    
    Constant Field Values
  - PIG_MAX_COMBINED_SPLIT_SIZE
```
public static final String PIG_MAX_COMBINED_SPLIT_SIZE
```
    Specifies the size, in bytes, of data to be processed by a single map. Smaller files are combined untill this size is reached.
    
    See Also:
    
    Constant Field Values
  - PIG_OUTPUT_LAZY
```
public static final String PIG_OUTPUT_LAZY
```
    This key is used to define whether PigOutputFormat will be wrapped with LazyOutputFormat so that jobs won't write empty part files if no output is generated
    
    See Also:
    
    Constant Field Values
  - PIG_OUTPUT_COMMITTER_RECOVERY
```
public static final String PIG_OUTPUT_COMMITTER_RECOVERY
```
    This key is used to define whether to support recovery to handle the application master getting restarted.
    
    See Also:
    
    Constant Field Values
  - PIG_TEMP_DIR
```
public static final String PIG_TEMP_DIR
```
    Location where pig stores temporary files for job setup
    
    See Also:
    
    Constant Field Values
  - PIG_ENABLE_TEMP_FILE_COMPRESSION
```
public static final String PIG_ENABLE_TEMP_FILE_COMPRESSION
```
    This key is used to define whether to have intermediate file compressed
    
    See Also:
    
    Constant Field Values
  - PIG_TEMP_FILE_COMPRESSION_STORAGE
```
public static final String PIG_TEMP_FILE_COMPRESSION_STORAGE
```
    This key is used to set the storage type used by intermediate file storage If pig.tmpfilecompression, default storage used is TFileStorage. This can be overriden to use SequenceFileInterStorage by setting following property to "seqfile".
    
    See Also:
    
    Constant Field Values
  - PIG_TEMP_FILE_COMPRESSION_CODEC
```
public static final String PIG_TEMP_FILE_COMPRESSION_CODEC
```
    Compression codec used by intermediate storage TFileStorage only support gzip and lzo.
    
    See Also:
    
    Constant Field Values
  - PIG_DELETE_TEMP_FILE
```
public static final String PIG_DELETE_TEMP_FILE
```
    This key is used to define whether to delete intermediate files of Hadoop jobs.
    
    See Also:
    
    Constant Field Values
  - PIG_POISSON_SAMPLER_SAMPLE_RATE
```
public static final String PIG_POISSON_SAMPLER_SAMPLE_RATE
```
    For a given mean and a confidence, a sample rate is obtained from a poisson udf
    
    See Also:
    
    Constant Field Values
  - PIG_RANDOM_SAMPLER_SAMPLE_SIZE
```
public static final String PIG_RANDOM_SAMPLER_SAMPLE_SIZE
```
    This key used to control the sample size of RandomeSampleLoader for order-by. The default value is 100 rows per task.
    
    See Also:
    
    Constant Field Values
  - PIG_DEFAULT_LOAD_FUNC
```
public static final String PIG_DEFAULT_LOAD_FUNC
```
    This key is used to define the default load func. Pig will fallback on PigStorage as default in case this is undefined.
    
    See Also:
    
    Constant Field Values
  - PIG_DEFAULT_STORE_FUNC
```
public static final String PIG_DEFAULT_STORE_FUNC
```
    This key is used to define the default store func. Pig will fallback on PigStorage as default in case this is undefined.
    
    See Also:
    
    Constant Field Values
  - PIG_SCRIPT_INFO_ENABLED
```
public static final String PIG_SCRIPT_INFO_ENABLED
```
    This key is used to turn off the inclusion of settings in the jobs.
    
    See Also:
    
    Constant Field Values
  - PIG_SCRIPT_MAX_SIZE
```
public static final String PIG_SCRIPT_MAX_SIZE
```
    Controls the size of Pig script stored in job xml.
    
    See Also:
    
    Constant Field Values
  - PIG_USER_CACHE_ENABLED
```
public static final String PIG_USER_CACHE_ENABLED
```
    This key is turn on the user level cache
    
    See Also:
    
    Constant Field Values
  - PIG_USER_CACHE_LOCATION
```
public static final String PIG_USER_CACHE_LOCATION
```
    Location where additional jars are cached for the user Additional jar will be cached under PIG_USER_CACHE_LOCATION/${user.name}/.pigcache and will be re-used across the jobs run by the user if the jar has not changed
    
    See Also:
    
    Constant Field Values
  - PIG_USER_CACHE_REPLICATION
```
public static final String PIG_USER_CACHE_REPLICATION
```
    Replication factor for files in pig jar cache
    
    See Also:
    
    Constant Field Values
  - PIG_ERROR_HANDLING_ENABLED
```
public static final String PIG_ERROR_HANDLING_ENABLED
```
    Boolean value used to enable or disable error handling for storers
    
    See Also:
    
    Constant Field Values
  - PIG_ERROR_HANDLING_MIN_ERROR_RECORDS
```
public static final String PIG_ERROR_HANDLING_MIN_ERROR_RECORDS
```
    Controls the minimum number of errors
    
    See Also:
    
    Constant Field Values
  - PIG_ERROR_HANDLING_THRESHOLD_PERCENT
```
public static final String PIG_ERROR_HANDLING_THRESHOLD_PERCENT
```
    Set the threshold for percentage of errors
    
    See Also:
    
    Constant Field Values
  - PIG_BLACKLIST
```
public static final String PIG_BLACKLIST
```
    Comma-delimited entries of commands/operators that must be disallowed. This is a security feature to be used by administrators to block use of commands by users. For eg, an admin might like to block all filesystem commands and setting configs in pig script. In which case, the entry would be "pig.blacklist=fs,set"
    
    See Also:
    
    Constant Field Values
  - PIG_WHITELIST
```
public static final String PIG_WHITELIST
```
    Comma-delimited entries of commands/operators that must be allowed. This is a security feature to be used by administrators to block use of commands by users that are not a part of the whitelist. For eg, an admin might like to allow only LOAD, STORE, FILTER, GROUP in pig script. In which case, the entry would be "pig.whitelist=load,store,filter,group"
    
    See Also:
    
    Constant Field Values
  - PIG_NO_TASK_REPORT
```
public static final String PIG_NO_TASK_REPORT
```
    This key is used to turns off use of task reports in job statistics.
    
    See Also:
    
    Constant Field Values
  - PIG_DATETIME_DEFAULT_TIMEZONE
```
public static final String PIG_DATETIME_DEFAULT_TIMEZONE
```
    The timezone to be used by Pig datetime datatype
    
    See Also:
    
    Constant Field Values
  - PIG_BZIP_USE_HADOOP_INPUTFORMAT
```
public static final String PIG_BZIP_USE_HADOOP_INPUTFORMAT
```
    Using hadoop's TextInputFormat for reading bzip input instead of using Pig's Bzip2TextInputFormat. True by default (only valid for 0.23/2.X)
    
    See Also:
    
    Constant Field Values
  - PIG_ARTIFACTS_DOWNLOAD_LOCATION
```
public static final String PIG_ARTIFACTS_DOWNLOAD_LOCATION
```
    This key is used to set the download location when registering an artifact using ivy coordinate
    
    See Also:
    
    Constant Field Values
  - PIG_TEZ_SESSION_REUSE
```
public static final String PIG_TEZ_SESSION_REUSE
```
    This key is used to define whether to reuse AM in Tez jobs.
    
    See Also:
    
    Constant Field Values
  - PIG_TEZ_DAG_STATUS_REPORT_INTERVAL
```
public static final String PIG_TEZ_DAG_STATUS_REPORT_INTERVAL
```
    This key is used to configure the interval of dag status report in seconds. Default is 20
    
    See Also:
    
    Constant Field Values
  - PIG_SPILL_MEMORY_USAGE_THRESHOLD_FRACTION
```
public static final String PIG_SPILL_MEMORY_USAGE_THRESHOLD_FRACTION
```
    Spill will be triggered if the fraction of biggest heap exceeds the usage threshold. If PigConfiguration.PIG_SPILL_UNUSED_MEMORY_THRESHOLD_SIZE is non-zero, then usage threshold is calculated as Max(HeapSize * PIG_SPILL_MEMORY_USAGE_THRESHOLD_FRACTION, HeapSize - PIG_SPILL_UNUSED_MEMORY_THRESHOLD_SIZE) Default is 0.7
    
    See Also:
    
    Constant Field Values
  - PIG_SPILL_COLLECTION_THRESHOLD_FRACTION
```
public static final String PIG_SPILL_COLLECTION_THRESHOLD_FRACTION
```
    Spill will be triggered if the fraction of biggest heap exceeds the collection threshold. If PigConfiguration.PIG_SPILL_UNUSED_MEMORY_THRESHOLD_SIZE is non-zero, then collection threshold is calculated as Max(HeapSize * PIG_SPILL_COLLECTION_THRESHOLD_FRACTION, HeapSize - PIG_SPILL_UNUSED_MEMORY_THRESHOLD_SIZE) Default is 0.7
    
    See Also:
    
    Constant Field Values
  - PIG_SPILL_UNUSED_MEMORY_THRESHOLD_SIZE
```
public static final String PIG_SPILL_UNUSED_MEMORY_THRESHOLD_SIZE
```
    Spill will be triggered when unused memory falls below the threshold. Default is 350MB
    
    See Also:
    
    Constant Field Values
  - PIG_LOG_TRACE_ID
```
public static final String PIG_LOG_TRACE_ID
```
    Log tracing id that can be used by upstream clients for tracking respective logs
    
    See Also:
    
    Constant Field Values
  - PIG_SPARK_USE_NETTY_FILESERVER
```
public static final String PIG_SPARK_USE_NETTY_FILESERVER
```
    Use Netty file server for Pig on Spark, true or false, default value is false
    
    See Also:
    
    Constant Field Values
  - CALLER_ID
```
public static final String CALLER_ID
```
    Deprecated. use PIG_LOG_TRACE_ID instead. Will be removed in Pig 0.18
    
    See Also:
    
    Constant Field Values
  - PIG_ATS_ENABLED
```
public static final String PIG_ATS_ENABLED
```
    Enable ATS for Pig
    
    See Also:
    
    Constant Field Values
  - ENABLE_ATS
```
public static final String ENABLE_ATS
```
    Deprecated. use PIG_ATS_ENABLED instead. Will be removed in Pig 0.18
    
    See Also:
    
    Constant Field Values
  - PIG_TEZ_CONFIGURE_AM_MEMORY
```
public static final String PIG_TEZ_CONFIGURE_AM_MEMORY
```
    If set, Pig will override tez.am.launch.cmd-opts and tez.am.resource.memory.mb to optimal
    
    See Also:
    
    Constant Field Values
  - PIG_STORE_SCHEMA_DISAMBIGUATE
```
public static final String PIG_STORE_SCHEMA_DISAMBIGUATE
```
    If set to false, automatic schema disambiguation gets disabled i.e. group::name will be just name
    
    See Also:
    
    Constant Field Values
  - PIG_STORE_SCHEMA_DISAMBIGUATE_DEFAULT
```
public static final String PIG_STORE_SCHEMA_DISAMBIGUATE_DEFAULT
```
    See Also:
    
    Constant Field Values
  - PIG_PRINT_EXEC_PLAN
```
public static final String PIG_PRINT_EXEC_PLAN
```
    See Also:
    
    Constant Field Values
  - OPT_FETCH
```
@Deprecated
public static final String OPT_FETCH
```
    Deprecated. use PIG_OPT_FETCH instead. Will be removed in Pig 0.16
    
    See Also:
    
    Constant Field Values
  - PROP_CACHEDBAG_MEMUSAGE
```
@Deprecated
public static final String PROP_CACHEDBAG_MEMUSAGE
```
    Deprecated. use PIG_CACHEDBAG_MEMUSAGE instead. Will be removed in Pig 0.16
    
    See Also:
    
    Constant Field Values
  - PROP_EXEC_MAP_PARTAGG
```
@Deprecated
public static final String PROP_EXEC_MAP_PARTAGG
```
    Deprecated. use PIG_EXEC_MAP_PARTAGG instead. Will be removed in Pig 0.16
    
    See Also:
    
    Constant Field Values
  - PARTAGG_MINREDUCTION
```
@Deprecated
public static final String PARTAGG_MINREDUCTION
```
    Deprecated. use PIG_EXEC_MAP_PARTAGG_MINREDUCTION instead. Will be removed in Pig 0.16
    
    See Also:
    
    Constant Field Values
  - PROP_NO_COMBINER
```
@Deprecated
public static final String PROP_NO_COMBINER
```
    Deprecated. use #PROP_NO_COMBINER1 instead. Will be removed in Pig 0.16
    
    See Also:
    
    Constant Field Values
  - SHOULD_USE_SCHEMA_TUPLE
```
@Deprecated
public static final String SHOULD_USE_SCHEMA_TUPLE
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - SCHEMA_TUPLE_SHOULD_USE_IN_UDF
```
@Deprecated
public static final String SCHEMA_TUPLE_SHOULD_USE_IN_UDF
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - SCHEMA_TUPLE_SHOULD_USE_IN_FOREACH
```
@Deprecated
public static final String SCHEMA_TUPLE_SHOULD_USE_IN_FOREACH
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - SCHEMA_TUPLE_SHOULD_USE_IN_FRJOIN
```
@Deprecated
public static final String SCHEMA_TUPLE_SHOULD_USE_IN_FRJOIN
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - SCHEMA_TUPLE_SHOULD_USE_IN_MERGEJOIN
```
@Deprecated
public static final String SCHEMA_TUPLE_SHOULD_USE_IN_MERGEJOIN
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - SCHEMA_TUPLE_SHOULD_ALLOW_FORCE
```
@Deprecated
public static final String SCHEMA_TUPLE_SHOULD_ALLOW_FORCE
```
    Deprecated.
    
    See Also:
    
    Constant Field Values
  - INSERT_ENABLED
```
@Deprecated
public static final String INSERT_ENABLED
```
    Deprecated. use PIG_SCRIPT_INFO_ENABLED instead. Will be removed in Pig 0.16
    
    See Also:
    
    Constant Field Values
  - MAX_SCRIPT_SIZE
```
@Deprecated
public static final String MAX_SCRIPT_SIZE
```
    Deprecated. use PIG_SCRIPT_MAX_SIZE instead. Will be removed in Pig 0.16
    
    See Also:
    
    Constant Field Values

Class PigConfiguration

Field Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

PIG_AUTO_LOCAL_ENABLED

PIG_AUTO_LOCAL_INPUT_MAXBYTES

PIG_OPT_FETCH

PIG_OPT_MULTIQUERY

PIG_OPT_ACCUMULATOR

PIG_ACCUMULATIVE_BATCHSIZE

PIG_TEZ_OPT_UNION

PIG_TEZ_OPT_UNION_SUPPORTED_STOREFUNCS

PIG_TEZ_OPT_UNION_UNSUPPORTED_STOREFUNCS

PIG_SORT_READONCE_LOADFUNCS

PIG_EXEC_MAP_PARTAGG

PIG_EXEC_MAP_PARTAGG_MINREDUCTION

PIG_EXEC_NO_COMBINER

PIG_EXEC_NO_COMBINER_REDUCER

PIG_EXEC_NO_SECONDARY_KEY

PIG_CACHEDBAG_MEMUSAGE

PIG_SKEWEDJOIN_REDUCE_MEMUSAGE

PIG_SKEWEDJOIN_REDUCE_MEM

PIG_BLOOMJOIN_STRATEGY

PIG_BLOOMJOIN_NUM_FILTERS

PIG_BLOOMJOIN_VECTORSIZE_BYTES

PIG_BLOOMJOIN_HASH_TYPE

PIG_BLOOMJOIN_HASH_FUNCTIONS

PIG_JOIN_REPLICATED_MAX_BYTES

PIG_CACHEDBAG_TYPE

PIG_CACHEDBAG_DISTINCT_TYPE

PIG_CACHEDBAG_SORT_TYPE

PIG_EXEC_REDUCER_ESTIMATOR

PIG_EXEC_REDUCER_ESTIMATOR_CONSTRUCTOR_ARG_KEY

PIG_TEZ_AUTO_PARALLELISM

PIG_TEZ_GRACE_PARALLELISM

PIG_TEZ_AUTO_PARALLELISM_DISABLE_DAG_RECOVERY

PIG_COMPRESS_INPUT_SPLITS

PIG_COMPRESS_INPUT_SPLITS_DEFAULT

PIG_TEZ_INPUT_SPLITS_MEM_THRESHOLD

PIG_TEZ_INPUT_SPLITS_MEM_THRESHOLD_DEFAULT

PIG_UDF_PROFILE

PIG_UDF_PROFILE_FREQUENCY

PIG_SCHEMA_TUPLE_ENABLED

PIG_SCHEMA_TUPLE_USE_IN_UDF

PIG_SCHEMA_TUPLE_USE_IN_FOREACH

PIG_SCHEMA_TUPLE_USE_IN_FRJOIN

PIG_SCHEMA_TUPLE_USE_IN_MERGEJOIN

PIG_SCHEMA_TUPLE_ALLOW_FORCE

PIG_STREAMING_ENVIRONMENT

PIG_STREAMING_UDF_PYTHON_COMMAND

PIG_SPLIT_COMBINATION

PIG_NO_SPLIT_COMBINATION

PIG_MAX_COMBINED_SPLIT_SIZE

PIG_OUTPUT_LAZY

PIG_OUTPUT_COMMITTER_RECOVERY

PIG_TEMP_DIR

PIG_ENABLE_TEMP_FILE_COMPRESSION

PIG_TEMP_FILE_COMPRESSION_STORAGE

PIG_TEMP_FILE_COMPRESSION_CODEC

PIG_DELETE_TEMP_FILE

PIG_POISSON_SAMPLER_SAMPLE_RATE

PIG_RANDOM_SAMPLER_SAMPLE_SIZE

PIG_DEFAULT_LOAD_FUNC

PIG_DEFAULT_STORE_FUNC

PIG_SCRIPT_INFO_ENABLED

PIG_SCRIPT_MAX_SIZE

PIG_USER_CACHE_ENABLED

PIG_USER_CACHE_LOCATION

PIG_USER_CACHE_REPLICATION

PIG_ERROR_HANDLING_ENABLED

PIG_ERROR_HANDLING_MIN_ERROR_RECORDS

PIG_ERROR_HANDLING_THRESHOLD_PERCENT

PIG_BLACKLIST

PIG_WHITELIST

PIG_NO_TASK_REPORT

PIG_DATETIME_DEFAULT_TIMEZONE

PIG_BZIP_USE_HADOOP_INPUTFORMAT

PIG_ARTIFACTS_DOWNLOAD_LOCATION

PIG_TEZ_SESSION_REUSE