Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Connections
  4. Mappings in the Hadoop Environment
  5. Mapping Objects in the Hadoop Environment
  6. Monitoring Mappings in the Hadoop Environment
  7. Mappings in the Native Environment
  8. Profiles
  9. Native Environment Optimization
  10. Data Type Reference
  11. Function Reference
  12. Parameter Reference

Execution Environment

Execution Environment

Configure Hadoop properties, Pushdown Configuration properties, and Source Configuration properties in the
Execution Environment
area.
Configure the following properties in a Hadoop Execution Environment:
Name
Value
Connection
Defines the connection information that the Data Integration Service requires to push the mapping execution to the Hadoop cluster. Select the Hadoop connection to run the mapping in the Hadoop cluster. You can assign a user-defined parameter for the Hadoop connection.
Execution Parameters
Overrides the Hadoop custom properties or the Spark default configuration parameters for the mapping. An execution parameter in the mapping properties overrides the same execution parameter that you enter in the Hadoop connection.
You can configure the following pushdown configuration properties:
Name
Value
Pushdown type
Choose one of the following options:
  • None. Select no pushdown type for the mapping.
  • Source. The Data Integration Service tries to push down transformation logic to the source database.
  • Full. The Data Integration pushes the full transformation logic to the source database.
Pushdown Capability
Optionally, if you choose full pushdown optimization and the mapping contains an Update Strategy transformation, you can choose a pushdown compatibility option or assign a pushdown compatibility parameter.
Choose one of the following options:
  • Multiple rows do not have the same key. The transformation connected to the Update Strategy transformation receives multiple rows without the same key. The Data Integration Service can push the transformation logic to the target.
  • Multiple rows with the same key can be reordered. The target transformation connected to the Update Strategy transformation receives multiple rows with the same key that can be reordered. The Data Integration Service can push the Update Strategy transformation to the Hadoop environment.
  • Multiple rows with the same key cannot be reordered. The target transformation connected to the Update Strategy transformation receives multiple rows with the same key that cannot be reordered. The Data Integration Service cannot push the Update Strategy transformation to the Hadoop environment.
You can configure the following source properties:
Name
Value
Maximum Rows Read
Reserved for future use.
Maximum Runtime Interval
Reserved for future use.
State Store
Reserved for future use.


Updated November 09, 2018