Communities
A collaborative platform to connect and grow with like-minded Informaticans across the globe
Product Communities
Connect and collaborate with Informatica experts and champions
Discussions
Have a question? Start a Discussion and get immediate answers you are looking for
User Groups
Customer-organized groups that meet online and in-person. Join today to network, share ideas, and get tips on how to get the most out of Informatica
Get Started
Community Guidelines
Knowledge Center
Troubleshooting documents, product guides, how to videos, best practices, and more
Knowledge Base
One-stop self-service portal for solutions, FAQs, Whitepapers, How Tos, Videos, and more
Support TV
Video channel for step-by-step instructions to use our products, best practices, troubleshooting tips, and much more
Documentation
Information library of the latest product documents
Velocity (Best Practices)
Best practices and use cases from the Implementation team
Learn
Rich resources to help you leverage full capabilities of our products
Trainings
Role-based training programs for the best ROI
Certifications
Get certified on Informatica products. Free, Foundation, or Professional
Product Learning Paths
Free and unlimited modules based on your expertise level and journey
Resources
Library of content to help you leverage the best of Informatica products
Tech Tuesdays Webinars
Most popular webinars on product architecture, best practices, and more
Product Availability Matrix
Product Availability Matrix statements of Informatica products
SupportFlash
Monthly support newsletter
Support Documents
Informatica Support Guide and Statements, Quick Start Guides, and Cloud Product Description Schedule
Product Lifecycle
End of Life statements of Informatica products
Ideas
Events
Change Request Tracking
Marketplace
English
  • PowerCenter 10.4.0
  • All Products

Table of Contents

Search

  1. Preface
  2. Part 1: Version 10.4.0
  3. Part 2: Version 10.2.2
  4. Part 3: Version 10.2.1
  5. Part 4: Version 10.2
  6. Part 5: Version 10.1.1
  7. Part 6: Version 10.1

Release Guide

Release Guide

Back Next

Hadoop Connection

Hadoop Connection

Effective in version 10.2, the following changes affect Hadoop connection properties.
You can use the following properties to configure your Hadoop connection:
Property
Description
Cluster Configuration
The name of the cluster configuration associated with the Hadoop environment.
Appears in General Properties.
Write Reject Files to Hadoop
Select the property to move the reject files to the HDFS location listed in the property Reject File Directory when you run mappings.
Appears in Reject Directory Properties.
Reject File Directory
The directory for Hadoop mapping files on HDFS when you run mappings.
Appears in Reject Directory Properties
Blaze Job Monitor Address
The host name and port number for the Blaze Job Monitor.
Appears in Blaze Configuration.
YARN Queue Name
The YARN scheduler queue name used by the Spark engine that specifies available resources on a cluster.
Appears in Blaze Configuration.
Effective in version 10.2, the following properties are renamed:
Current Name
Previous Name
Description
ImpersonationUserName
HiveUserName
Hadoop impersonation user. The user name that the Data Integration Service impersonates to run mappings in the Hadoop environment.
Hive Staging Database Name
Database Name
Namespace for Hive staging tables.
Appears in Common Properties.
Previously appeared in Hive Properties.
HiveWarehouseDirectory
HiveWarehouseDirectoryOnHDFS
The absolute HDFS file path of the default database for the warehouse that is local to the cluster.
Blaze Staging Directory
Temporary Working Directory on HDFS
CadiWorkingDirectory
The HDFS file path of the directory that the Blaze engine uses to store temporary files.
Appears in Blaze Configuration.
Blaze User Name
Blaze Service User Name
CadiUserName
The owner of the Blaze service and Blaze service logs.
Appears in Blaze Configuration.
YARN Queue Name
Yarn Queue Name
CadiAppYarnQueueName
The YARN scheduler queue name used by the Blaze engine that specifies available resources on a cluster.
Appears in Blaze Configuration.
BlazeMaxPort
CadiMaxPort
The maximum value for the port number range for the Blaze engine.
BlazeMinPort
CadiMinPort
The minimum value for the port number range for the Blaze engine.
BlazeExecutionParameterList
CadiExecutionParameterList
An optional list of configuration parameters to apply to the Blaze engine.
SparkYarnQueueName
YarnQueueName
The YARN scheduler queue name used by the Spark engine that specifies available resources on a cluster.
Spark Staging Directory
Spark HDFS Staging Directory
The HDFS file path of the directory that the Spark engine uses to store temporary files for running jobs.
Effective in version 10.2, the following properties are removed from the connection and imported into the cluster configuration:
Property
Description
Resource Manager Address
The service within Hadoop that submits requests for resources or spawns YARN applications.
Imported into the cluster configuration as the property
yarn.resourcemanager.address
.
Previously appeared in Hadoop Cluster Properties.
Default File System URI
The URI to access the default Hadoop Distributed File System.
Imported into the cluster configuration as the property
fs.defaultFS
 or
fs.default.name
.
Previously appeared in Hadoop Cluster Properties.
Effective in version 10.2, the following properties are deprecated and are removed from the connection:
Property
Description
Type
The connection type.
Previously appeared in General Properties.
Metastore Execution Mode*
Controls whether to connect to a remote metastore or a local metastore.
Previously appeared in Hive Configuration.
Metastore Database URI*
The JDBC connection URI used to access the data store in a local metastore setup.
Previously appeared in Hive Configuration.
Metastore Database Driver*
Driver class name for the JDBC data store.
Previously appeared in Hive Configuration.
Metastore Database User Name*
The metastore database user name.
Previously appeared in Hive Configuration.
Metastore Database Password*
The password for the metastore user name.
Previously appeared in Hive Configuration.
Remote Metastore URI*
The metastore URI used to access metadata in a remote metastore setup.
This property is imported into the cluster configuration as the property
hive.metastore.uris
.
Previously appeared in Hive Configuration.
Job Monitoring URL
The URL for the MapReduce JobHistory server.
Previously appeared in Hive Configuration.
* These properties are deprecated in 10.2. When you upgrade to 10.2, the property values that you set in a previous release are saved in the repository, but they do not appear in the connection properties.
0 COMMENTS
We’d like to hear from you!