Class and Description |
---|
JobMetricsListener |
SparkEngineConf
The object of SparkEngineConf is to solve the initialization problem of PigContext.properties.get("udf.import.list"),
UDFContext#udfConfs, UDFContext#clientSysProps in spark mode.
|
SparkExecType |
SparkLauncher.ResourceType |
SparkPigContext
singleton class like PigContext
|
SparkPigSplit
Wrapper class for PigSplits in Spark mode
Spark only counts HDFS bytes read if we provide a FileSplit, so we have to wrap PigSplits and have the wrapper
class extend FileSplit
|
Class and Description |
---|
SparkEngineConf
The object of SparkEngineConf is to solve the initialization problem of PigContext.properties.get("udf.import.list"),
UDFContext#udfConfs, UDFContext#clientSysProps in spark mode.
|
Class and Description |
---|
JobMetricsListener |
Copyright © 2007-2017 The Apache Software Foundation