org.apache.pig.backend.hadoop.executionengine.tez

Class TezJobCompiler

java.lang.Object

org.apache.pig.backend.hadoop.executionengine.tez.TezJobCompiler

public class TezJobCompiler
extends Object

This is compiler class that takes a TezOperPlan and converts it into a JobControl object with the relevant dependency info maintained. The JobControl object is made up of TezJobs each of which has a JobConf.

Constructor Summary

Constructors

Constructor and Description
TezJobCompiler(PigContext pigContext, org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method and Description
org.apache.tez.dag.api.DAG	buildDAG(TezPlanContainerNode tezPlanNode, Map<String,org.apache.hadoop.yarn.api.records.LocalResource> localResources)
TezJob	compile(TezPlanContainerNode tezPlanNode, TezPlanContainer planContainer)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TezJobCompiler

public TezJobCompiler(PigContext pigContext,
                      org.apache.hadoop.conf.Configuration conf)
               throws IOException

Throws:

IOException

Method Detail

buildDAG

public org.apache.tez.dag.api.DAG buildDAG(TezPlanContainerNode tezPlanNode,
                                           Map<String,org.apache.hadoop.yarn.api.records.LocalResource> localResources)
                                    throws IOException,
                                           org.apache.hadoop.yarn.exceptions.YarnException

Throws:

IOException

org.apache.hadoop.yarn.exceptions.YarnException

compile

public TezJob compile(TezPlanContainerNode tezPlanNode,
                      TezPlanContainer planContainer)
               throws JobCreationException

Throws:

JobCreationException