Release Guide

10.4.0
- 10.4.1

Back Next

Blaze Engine

Effective in version 10.1.1, the Blaze engine has the following new features:

Hive Sources and Targets on the Blaze Engine

Effective in version 10.1.1, Hive sources and targets have the following additional support on the Blaze engine:

Hive decimal data type values with precision 38

Quoted identifiers in Hive table names, column names, and schema names

Partitioned Hive tables as targets

Bucketed Hive tables as source and targets

SQL overrides for Hive sources

Table locking for Hive sources and targets

Create or replace target tables for Hive targets

Truncate target table for Hive targets and Hive partitioned tables

For more information, see the "Mapping Objects in the Hadoop Environment" chapter in the

Informatica Big Data Management® 10.1.1 User Guide

Transformation Support on the Blaze Engine

Effective in version 10.1.1, transformations have the following additional support on the Blaze engine:

Lookup transformation. You can use SQL overrides and filter queries with Hive lookup sources.

Sorter transformation. Global sorts are supported when the Sorter transformation is connected to a flat file target. To maintain global sort order, you must enable the Maintain Row Order property in the flat file target. If the Sorter transformation is midstream in the mapping, then rows are sorted locally.

Update Strategy transformation. The Update Strategy transformation is supported with some restrictions.

For more information, see the "Mapping Objects in the Hadoop Environment" chapter in the

Informatica Big Data Management 10.1.1 User Guide

Blaze Engine Monitoring

Effective in Version 10.1.1, more detailed statistics about mapping jobs are available in the Blaze Summary Report. In the Blaze Job Monitor, a green summary report button appears beside the names of successful grid tasks which opens the Blaze Summary Report.

The Blaze Summary Report contains the following information about a mapping job:

Time taken by individual segments. A pie chart of segments within the grid task.

Mapping properties. A table containing basic information about the mapping job.

Tasklet execution time. A time series graph of all tasklets within the selected segment.

Selected tasklet information. Source and target row counts and cache information for each individual tasklet.

The Blaze Summary Report is in beta. It contains most of the major features, but is not yet complete.

Blaze Engine Logs

Effective in version 10.1.1, the following error logging enhancements are available on the Blaze engine:

Execution statistics are available in the LDTM log when the log tracing level is set to verbose initialization or verbose data. The log includes the following mapping execution details:

Start time, end time, and state of each task

Blaze Job Monitor URL

Number of total, succeeded, and failed/cancelled tasklets

Number of processed and rejected rows for sources and targets

Data errors, if any, for transformations in each executed segment

The LDTM log includes the following transformation statistics:

Number of output rows for sources and targets

Number of error rows for sources and targets

The session log also displays a list of all segments within the grid task with corresponding links to the Blaze Job Monitor. Click on a link to see the execution details of that segment.

For more information, see the "Monitoring Mappings in a Hadoop Environment" chapter in the

Rename Saved Search

Table of Contents

Release Guide

Release Guide

Blaze Engine

Blaze Engine

Hive Sources and Targets on the Blaze Engine

Transformation Support on the Blaze Engine

Blaze Engine Monitoring

Blaze Engine Logs