org.apache.pig.newplan.logical.rules

Class MapKeysPruneHelper

java.lang.Object

org.apache.pig.newplan.logical.rules.MapKeysPruneHelper

public class MapKeysPruneHelper
extends Object

This filter Marks every Load Operator which has a Map with MAP_MARKER_ANNOTATION. The annotation value is Map> where Integer is the column number of the field and Set is the set of Keys in this field ( field is a map field only ). It does this for only the top level schema in load. Algorithm: Traverse the Plan in ReverseDependency order ( ie. Sink to Source ) For LogicalRelationalOperators having MapLookupExpression in their expressionPlan collect uid and keys related to it. This is retained in the visitor For ForEach having nested LogicalPlan use the same visitor hence there is no distinction required At Sources find all the uids provided by this source and annotate this LogicalRelationalOperator ( load ) with Map> containing only the column numbers that this LogicalRelationalOperator generates NOTE: This is a simple Map Pruner. If a map key is mentioned in the script then this pruner assumes you need the key. This pruner is not as optimized as column pruner ( which removes a column if it is mentioned but never used )

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MapKeysPruneHelper.FullMapCollector
static class	MapKeysPruneHelper.MapMarker This class collects all the information required to create the list of keys required for a map

Field Summary

Fields

Modifier and Type	Field and Description
static String	REQUIRED_MAPKEYS

Constructor Summary

Constructors

Constructor and Description
MapKeysPruneHelper(OperatorPlan currentPlan)

Method Summary

Modifier and Type	Method and Description
boolean	check()
OperatorPlan	reportChanges()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

REQUIRED_MAPKEYS

public static final String REQUIRED_MAPKEYS

See Also:

Constant Field Values

Constructor Detail

MapKeysPruneHelper

public MapKeysPruneHelper(OperatorPlan currentPlan)

Method Detail

check

public boolean check()
              throws FrontendException

Throws:

FrontendException

reportChanges

public OperatorPlan reportChanges()