Class and Description |
---|
FlatMapFunctionAdapter |
JobStatisticCollector |
PairFlatMapFunctionAdapter |
SparkEngineConf
The object of SparkEngineConf is to solve the initialization problem of PigContext.properties.get("udf.import.list"),
UDFContext#udfConfs, UDFContext#clientSysProps in spark mode.
|
SparkExecType |
SparkLauncher.ResourceType |
SparkPigContext
singleton class like PigContext
|
SparkPigSplit
Wrapper class for PigSplits in Spark mode
Spark only counts HDFS bytes read if we provide a FileSplit, so we have to wrap PigSplits and have the wrapper
class extend FileSplit
|
Class and Description |
---|
SparkEngineConf
The object of SparkEngineConf is to solve the initialization problem of PigContext.properties.get("udf.import.list"),
UDFContext#udfConfs, UDFContext#clientSysProps in spark mode.
|
Class and Description |
---|
JobStatisticCollector |
Copyright © 2007-2025 The Apache Software Foundation