Runtime Environments

Back Next

Environment configuration

Configure the elastic runtime environment properties to determine how

Informatica Intelligent Cloud Services

runs the Kubernetes cluster and processes data in the elastic runtime environment.

Platform

The following table describes the platform properties:

Property	Description
Region	Region in which to create the elastic runtime environment. You can't update the region after you deploy the elastic runtime environment.
Worker Instance Type	Instance type to host the worker nodes. To verify that the instance type is supported in your AWS setup, refer to the AWS documentation. The worker nodes for the Secure Agent services use the same instance type as the master node.
Worker Instance Profile	Instance profile to attach to worker nodes. The instance profile is the value at the end of the ARN.
Enable High Availability	Enables high availability for the elastic runtime environment. When high availability is enabled, the elastic runtime environment maintains an odd number of master nodes. Because you manually create one original master node as part of the setup, the environment creates an additional, even number of master nodes based on the number of subnets that you provide. For example, if you provide two subnets, the environment will have a total of three master nodes. Worker nodes are always highly available and are created across multiple availability zones and subnets regardless of whether high availability is enabled. For more information about high availability, refer to the Kubernetes documentation.
Subnets	Subnet IDs from different regions when high availability is enabled. Enter the subnet ID for at least two subnets. For example: subnet-01234567890abcdef A master node is created in each subnet as long as the total number of master nodes is an odd number. Each master node in the environment, including the original master node, must be in a different region. The created master nodes use the same configuration as the original master node but have different IP addresses.
EBS Volume Size	Size of the EBS volume to attach to a worker node for temporary storage during data processing.

An elastic runtime environment can become highly available to eliminate a single point of failure when the master node goes down. If you enable high availability and one master node goes down, other master nodes will be available and jobs can continue running.

When an elastic runtime environment is highly available, watch out for job failures in the following scenarios:

If all master nodes go down, jobs will fail.

If too many master nodes go down, the Kubernetes API server becomes unavailable. The threshold for the number of failures is

(n+1)/2

where

is the number of master nodes. For example, if the cluster has 3 master nodes and 2 master nodes go down, the Kubernetes API server becomes unavailable and jobs fail on the cluster.

Job auto-scaling policy

An elastic runtime environment uses the following sets of worker nodes:

Worker nodes that run jobs. The job auto-scaling policy determines the number of worker nodes that are created to run jobs in the organization.

Worker nodes that run the Secure Agent services. This set of worker nodes scales automatically to accommodate high job volume.

If no jobs are submitted to the elastic runtime environment by the time it reaches the worker node idle timeout, the number of worker nodes is calculated using the following equation:

(min worker nodes in job auto-scaling policy) + (worker nodes for Secure Agent services)

Even if the minimum number of worker nodes in the job auto-scaling policy is set to zero, the environment has at least one worker node that runs the Secure Agent services.

The following table describes the properties in the job auto-scaling policy:

Property	Description
Min Worker Nodes	Minimum number of worker nodes.
Max Worker Nodes	Maximum number of worker nodes.
Worker Node Idle Timeout	Amount of idle time before a worker node times out.

System storage

The following table describes the system storage properties:

Property	Description
Type	Type of system storage. Select EFS.
File System	File system ID for the EFS file system.
Source Mount	File system path to mount in the elastic runtime environment. Exclude the initial forward slash. For example, if the path is /sysdisk , use sysdisk .
Access Point	Access point ID for the EFS file system. The ID is the alphanumeric value at the end of the ARN.

Data storage

The following table describes the data storage properties:

Property	Description
Type	Type of data storage. Select EFS.
File System	File system ID for the EFS file system.
Source Mount	File system path to mount in the elastic runtime environment. Exclude the initial forward slash. For example, if the path is /datadisk , use datadisk .
Access Point	Access point ID for the EFS file system. The ID is the alphanumeric value at the end of the ARN.

Advanced configuration

The following table describes the advanced properties:

Property	Description
Cloud Ecosystem Tags	Tags for cloud resources. Add at least one tag. The NAME and Name tags are reserved for system use. You can't update the tags after you deploy the elastic runtime environment.
Runtime Properties	Properties to customize the elastic runtime environment and the jobs that run in the environment.

Rename Saved Search

Table of Contents

Runtime Environments

Runtime Environments

Environment configuration

Environment configuration

Platform

Job auto-scaling policy

System storage

Data storage

Advanced configuration