Table of Contents

Search

  1. Abstract
  2. Supported Versions
  3. Integrating Informatica® Big Data Management 10.2.2 HF1 SP1 with Qubole

Integrating Informatica® Big Data Management 10.2.2 HF1 SP1 with Qubole

Integrating Informatica® Big Data Management 10.2.2 HF1 SP1 with Qubole

Configure Advanced Properties

Configure Advanced Properties

In the next panel of the cluster creation wizard, you configure advanced properties.

EC2 Settings

The following table describes EC2 settings to configure:
Property
Description
Same as Default Compute
Check this option if you want the cluster to use the default compute settings for the user account.
Default is selected.
VPC
Click the dropdown and select the AWS VPC where the Informatica domain is deployed.
Default: None.
Subnet
Click the dropdown and select the AWS VPC subnet where the Informatica domain is deployed.
Default: None.
Elastic IP for Master Node
Supply the elastic IP address of the cluster master node.
Custom EC2 Tags
Type a string to identify cluster nodes that are part of the Informatica integration.
To enable reporting, add the following tag:
Informatica_BDM_10.2.2

Hadoop Cluster Settings

The following table describes Hadoop cluster settings to configure:
Property
Description
Override Hadoop Configuration Variables
Use the text field to enter custom variables to enable Big Data Management integration. When you enter values in this field, Qubole updates the *-site.xml configuration files on each cluster node.
For the integration with Big Data Management, enter the following key-value pair to set the YARN node manager timeout:
yarn.resourcemanager.app.timeout.minutes=-1
Do not enter values for any of the other settings in this section.

Spark Settings

It is not necessary to change any of the settings in this section.

Monitoring

It is not necessary to change any of the settings in this section.

Security Settings

The following table describes security settings to configure:
Property
Description
Qubole Public Key
Qubole automatically populates this field with a public key.
Customer SSH Public Key
Public key for the Informatica domain VM. Qubole requires this key to establish communication between the Qubole cluster and the domain.
Enter the SSH public key that you created previously. The value is stored in the file
id_rsa.pub
in the directory on the Big Data Management domain node that you created when you created the RSA keys. See Generate RSA Keys.
Persistent Security Groups
Enter the name of the IAM security group that you created for the Qubole-Big Data Management integration.
Do not enter values for any of the other settings in this section.
Click
OK
to complete cluster creation.

0 COMMENTS

We’d like to hear from you!