English
  • Shared Content for Data Engineering 10.1.1 HotFix 1
  • All Products

Table of Contents

Search

  1. Version 10.1.1
  2. Version 10.1
  3. Version 10.0
  4. Version 9.6.1
  5. Version 9.6.0

Release Guide

Release Guide

Back Next

Blaze Engine

Effective in version 10.1.1, the Blaze engine has the following new features:
Effective in version 10.1.1, Hive sources and targets have the following additional support on the Blaze engine:
  • Hive decimal data type values with precision 38
  • Quoted identifiers in Hive table names, column names, and schema names
  • Partitioned Hive tables as targets
  • Bucketed Hive tables as source and targets
  • SQL overrides for Hive sources
  • Table locking for Hive sources and targets
  • Create or replace target tables for Hive targets
  • Truncate target table for Hive targets and Hive partitioned tables
For more information, see the "Mapping Objects in the Hadoop Environment" chapter in the
Informatica Big Data Management® 10.1.1 User Guide
.
Effective in version 10.1.1, transformations have the following additional support on the Blaze engine:
  • Lookup transformation. You can use SQL overrides and filter queries with Hive lookup sources.
  • Sorter transformation. Global sorts are supported when the Sorter transformation is connected to a flat file target. To maintain global sort order, you must enable the Maintain Row Order property in the flat file target. If the Sorter transformation is midstream in the mapping, then rows are sorted locally.
  • Update Strategy transformation. The Update Strategy transformation is supported with some restrictions.
For more information, see the "Mapping Objects in the Hadoop Environment" chapter in the
Informatica Big Data Management 10.1.1 User Guide
.
Effective in Version 10.1.1, more detailed statistics about mapping jobs are available in the Blaze Summary Report. In the Blaze Job Monitor, a green summary report button appears beside the names of successful grid tasks which opens the Blaze Summary Report.
The Blaze Summary Report contains the following information about a mapping job:
  • Time taken by individual segments. A pie chart of segments within the grid task.
  • Mapping properties. A table containing basic information about the mapping job.
  • Tasklet execution time. A time series graph of all tasklets within the selected segment.
  • Selected tasklet information. Source and target row counts and cache information for each individual tasklet.
The Blaze Summary Report is in beta. It contains most of the major features, but is not yet complete.
Effective in version 10.1.1, the following error logging enhancements are available on the Blaze engine:
  • Execution statistics are available in the LDTM log when the log tracing level is set to verbose initialization or verbose data. The log includes the following mapping execution details:
    • Start time, end time, and state of each task
    • Blaze Job Monitor URL
    • Number of total, succeeded, and failed/cancelled tasklets
    • Number of processed and rejected rows for sources and targets
    • Data errors, if any, for transformations in each executed segment
  • The LDTM log includes the following transformation statistics:
    • Number of output rows for sources and targets
    • Number of error rows for sources and targets
  • The session log also displays a list of all segments within the grid task with corresponding links to the Blaze Job Monitor. Click on a link to see the execution details of that segment.
For more information, see the "Monitoring Mappings in a Hadoop Environment" chapter in the
Informatica Big Data Management 10.1.1 User Guide
.