Profiling and Discovery Sizing Guidelines

Back Next

Temporary Disk Space Worksheet

When you estimate the temporary disk space required for a specific mix of profile jobs, you can start with the minimal amount of recommended temporary disk space. The base temporary disk recommendation of 50 GB. You can then add more temporary disk memory based on the types of profile jobs and data that the profile jobs use. Performance improves when the additional disk memory is split across multiple physical disks.

Some of the profile operations require temporary disk space to cache the intermediate computation for flat files and profile types, such as column profile and data domain discovery.

In the Concurrency column in the following worksheet, enter the expected number of jobs for each profile type that run in parallel. The Temporary Disk column lists the values for each profile job type. Multiply the values in the Concurrency and Temporary Disk columns for each row and update the "A x B" column.

Use the following worksheet to record the values:

Profile Operation	Concurrency (A)	Temporary Disk (B)	A x B
Scorecard (flat file)		5 GB
Column Profile (flat file)		10 GB
Data Domain Discovery (flat file)		10 GB
Primary Key Discovery		25 GB
Functional Dependency Discovery		25 GB

The base temporary disk recommendation of 50 GB meets the memory requirements of the following profile operations:

Run a scorecard on a relational source

Run a column profile on a relational source

Perform data domain discovery on a relational source

Perform foreign key discovery

Perform overlap discovery

Calculation

Add all the values in the "A x B" column. Then, add the base temporary disk size of 50 GB with the total value of the "A x B" column to compute the required disk space for the development deployment.

Rename Saved Search

Table of Contents

Profiling and Discovery Sizing Guidelines

Profiling and Discovery Sizing Guidelines

Temporary Disk Space Worksheet

Temporary Disk Space Worksheet