Table of Contents

Search

  1. Preface
  2. Part 1: Hadoop Integration
  3. Part 2: Databricks Integration
  4. Appendix A: Connections Reference

Verify or Refresh the Cluster Configuration

Verify or Refresh the Cluster Configuration

You might need to refresh the cluster configuration or update the distribution version in the cluster configuration when you upgrade.
Perform this task in the following situation:
  • You upgraded from version 10.2 or later.

Verify the Cluster Configuration

The cluster configuration contains a property for the distribution version. The verification task depends on the version you upgraded:
Upgrade from 10.2
If you upgraded from 10.2 and you changed the distribution version, you need to verify the distribution version in the General properties of the cluster configuration.
For Hortonworks HDP, the HDP 3.1 version is populated by default. If you were using HDP version 2.6, use the UpdateConfiguration command to specify HDP 2.6. For information about the command, see the
Informatica Command Reference.
Upgrade from 10.2.1
Effective in version 10.2.1, Informatica assigns a default version to each Hadoop distribution type. If you configure the cluster configuration to use the default version, the upgrade process upgrades to the assigned default version if the version changes. If you have not upgraded your Hadoop distribution to Informatica's default version, you need to update the distribution version property.
For example, suppose the assigned default Hadoop distribution version for 10.2.1 is
n
, and for 10.2.2 is
n+1
. If the cluster configuration uses the default supported Hadoop version of
n
, the upgraded cluster configuration uses the default version of
n+1
. If you have not upgraded the distribution in the Hadoop environment you need to change the cluster configuration to use version
n
.
If you configure the cluster configuration to use a distribution version that is not the default version, you need to update the distribution version property in the following circumstances:
  • Informatica dropped support for the distribution version.
  • You changed the distribution version.

Refresh the Cluster Configuration

If you updated any of the *-site.xml files noted in the topic to prepare for cluster import, you need to refresh the cluster configuration in the Administrator tool.