| Class and Description |
|---|
| FlatMapFunctionAdapter |
| JobStatisticCollector |
| PairFlatMapFunctionAdapter |
| SparkEngineConf
The object of SparkEngineConf is to solve the initialization problem of PigContext.properties.get("udf.import.list"),
UDFContext#udfConfs, UDFContext#clientSysProps in spark mode.
|
| SparkExecType |
| SparkLauncher.ResourceType |
| SparkPigContext
singleton class like PigContext
|
| SparkPigSplit
Wrapper class for PigSplits in Spark mode
Spark only counts HDFS bytes read if we provide a FileSplit, so we have to wrap PigSplits and have the wrapper
class extend FileSplit
|
| Class and Description |
|---|
| SparkEngineConf
The object of SparkEngineConf is to solve the initialization problem of PigContext.properties.get("udf.import.list"),
UDFContext#udfConfs, UDFContext#clientSysProps in spark mode.
|
| Class and Description |
|---|
| JobStatisticCollector |
Copyright © 2007-2025 The Apache Software Foundation