Table of Contents

Search

  1. Abstract for Profiling Sizing Guidelines
  2. Supported Versions
  3. Profiling and Discovery Sizing Guidelines

Profiling and Discovery Sizing Guidelines

Profiling and Discovery Sizing Guidelines

CPU Cores Worksheet

CPU Cores Worksheet

As part of the development deployment, estimate the number of CPU cores for the nodes of the Data Integration Service machine required for a specific combination of profile jobs. The estimated CPU cores is the computed total number of CPU cores required for the nodes of the Data Integration Service machine.
You can use the following worksheet for all profile jobs except enterprise discovery. Enterprise discovery jobs runs at a lower priority than the standard profile jobs. Concurrency is the expected number of jobs of each profile type that run in parallel. Weight is the percentage of the profile jobs that run for each profile type.
In the Concurrency column in the following worksheet, enter the expected number of jobs of each profile type that run in parallel. The Average Cores column lists the values for each profile job type. In the Weight column, enter the percentage of the profile jobs that run for each profile type. Split the weight values for each profile job type so that the total of all the weight values in the worksheet is 100. Multiply the values in each column and update the "A x B x C" column.
Use the following worksheet to record values:
Profile Operation
Concurrency (A)
Average Cores (B)
Weight (C)
A x B x C
Scorecard (flat file)
2.3
Scorecard (relational source)
2.0
Column Profile (flat file)
2.3
Column Profile (relational source)
2.0
Data Domain Discovery (flat file)
2.3
Data Domain Discovery (relational source)
2.0
Primary Key Discovery
1.0
Functional Dependency Discovery
1.0
Foreign Key Discovery
2.0
Overlap Discovery
2.0
Calculation
To calculate the number of estimated CPU cores, add all the values in the "A x B x C" column and divide the total value by 100. You can then plan for the nodes of the Data Integration Service machine with the calculated number of CPU cores.

0 COMMENTS

We’d like to hear from you!