Table of Contents

Search

  1. Version 10.0
  2. Version 9.6.1
  3. Version 9.6.0

Big Data

This section describes new big data features in version 9.6.1 HotFix 1.
Big Data Edition has the following new features and enhancements for data warehousing:
Binary Data Type
Effective in version 9.6.1 HotFix 1, a mapping in the Hive environment can process binary data when it passes through the ports in a mapping. However, the mapping cannot process expression functions that use binary data.
For more information, see the
Informatica 9.6.1 HotFix 1 Big Data Edition User Guide
.
Truncate Partitions in a Hive Target
Effective in version 9.6.1 HotFix 1, the Data Integration Service can truncate the partition in the Hive target. You must choose to both truncate the partition in the Hive target and truncate the target table.
For more information, see the
Informatica 9.6.1 HotFix 1 Big Data Edition User Guide
.
Effective in version 9.6.1 HotFix 1, Big Data Edition added support for the following Hadoop distributions:
  • Cloudera CDH 5.1
  • Hortonworks HDP 2.1
Big Data Edition dropped support for Hortonworks HDP 2.0.
For more information, see the
Informatica 9.6.1 HotFix 1 Big Data Edition Installation and Configuration Guide
.
Big Data Edition has the following new features and enhancements for the Hadoop ecosystem:
Cloudera Manager
Effective in version 9.6.1 HotFix 1, you can use Cloudera Manager to distribute the Big Data Edition installation as parcels across the Hadoop cluster nodes for Cloudera CDH 5.1.
For more information, see the
Informatica 9.6.1 HotFix 1 Big Data Edition Installation and Configuration Guide
.
High Availability
Effective in version 9.6.1 HotFix 1, you can enable the Data Integration Service and the Developer tool to read from and write to a highly available Hadoop cluster. A highly available Hadoop cluster can provide uninterrupted access to the JobTracker, NameNode, and ResourceManager in the cluster. You must configure the Developer tool to communicate with a highly available Hadoop cluster on a Hadoop distribution.
For more information, see the
Informatica 9.6.1 HotFix 1 Big Data Edition Installation and Configuration Guide
.
Kerberos Authentication
Effective in version 9.6.1 HotFix 1, you can configure the Informatica domain that uses Kerberos authentication to run mappings in a Hadoop cluster that also uses Kerberos authentication. You must configure a one-way cross-realm trust to enable the Hadoop cluster to communicate with the Informatica domain.
Previously, you could run mappings in a Hadoop cluster that used Kerberos authentication if the Informatica domain did not use Kerberos authentication.
For more information, see the
Informatica 9.6.1 HotFix 1 Big Data Edition User Guide
.
Schedulers
Effective in version 9.6.1 HotFix 1, the following schedulers are valid for Hadoop distributions:
  • Capacity scheduler
  • Fair scheduler
For more information, see the
Informatica 9.6.1 HotFix 1 Big Data Edition Installation and Configuration Guide
.


Updated April 09, 2019