Designer Guide

10.4.1
- 10.5
- 10.4.0

Back Next

Decimal and Double Values in Calculations

The following table lists how the PowerCenter Integration Service handles decimal values based on high precision configuration:

The following table lists how the Data Integration Service handles decimal values based on high precision configuration:

Port Data Type	Precision	High Precision Off	High Precision On
Decimal	0 to 15	Decimal	Decimal
Decimal	15 to 28 15 to 38 for transformations that support the Decimal data type with precision up to 38 digits. 15 to 28 for transformations that support the Decimal data type with precision up to 28 digits. 15 to 38 for transformations that support the Decimal data type with precision up to 38 digits. 15 to 28 for transformations that support Decimal data type of precision up to 28 digits.	Double	Decimal
Decimal	Over 28 Over 38 for transformations that support the Decimal data type with precision up to 38 digits. Over 28 for transformations that support the Decimal data type with precision up to 28 digits. Over 38 for transformations that support the Decimal data type with precision up to 38 digits. Over 28 for transformations that support the Decimal data type with precision up to 28 digits.	Double	Double

When you enable high precision, the PowerCenter Integration Service converts numeric constants in any expression function to Decimal. If you do not enable high precision, the PowerCenter Integration Service converts numeric constants to Double.

When you enable high precision, the Data Integration Service converts numeric constants in any expression function to Decimal. If you do not enable high precision, the Data Integration Service converts numeric constants to Double.

You can ensure the maximum precision for numeric values greater than 28 or 38 digits depending on the transformation. Before you perform any calculations or transformations with the transformation functions, truncate or round any large numbers.

For transformations that support Decimal data type of precision up to 38 digits, use the Decimal data type and enable high precision to ensure precision of up to 38 digits.

For transformations that support Decimal data type of precision up to 28 digits, use the Decimal data type and enable high precision to ensure precision of up to 28 digits.

Do not use the Double data type for data that you use in an equality condition, such as a lookup or join condition.

Rename Saved Search

Table of Contents

Designer Guide

Designer Guide

Decimal and Double Values in Calculations

Decimal and Double Values in Calculations