Table of Contents

Search

  1. Preface
  2. Using the Designer
  3. Working with Sources
  4. Working with Flat Files
  5. Working with Targets
  6. Mappings
  7. Mapplets
  8. Mapping Parameters and Variables
  9. Working with User-Defined Functions
  10. Using the Debugger
  11. Viewing Data Lineage
  12. Comparing Objects
  13. Managing Business Components
  14. Creating Cubes and Dimensions
  15. Using the Mapping Wizards
  16. Datatype Reference
  17. Configure the Web Browser

Decimal and Double Values in Calculations

Decimal and Double Values in Calculations

The following table lists how the PowerCenter Integration Service handles decimal values based on high precision configuration:
The following table lists how the Data Integration Service handles decimal values based on high precision configuration:
The following table lists how the Data Integration Service handles decimal values based on high precision configuration:
Port Data Type
Precision
High Precision Off
High Precision On
Decimal
0 to 15
Decimal
Decimal
Decimal
15 to 28
15 to 38 for transformations that support the Decimal data type with precision up to 38 digits.
15 to 28 for transformations that support the Decimal data type with precision up to 28 digits.
15 to 38 for transformations that support the Decimal data type with precision up to 38 digits.
15 to 28 for transformations that support Decimal data type of precision up to 28 digits.
Double
Decimal
Decimal
Over 28
Over 38 for transformations that support the Decimal data type with precision up to 38 digits.
Over 28 for transformations that support the Decimal data type with precision up to 28 digits.
Over 38 for transformations that support the Decimal data type with precision up to 38 digits.
Over 28 for transformations that support the Decimal data type with precision up to 28 digits.
Double
Double
When you enable high precision, the PowerCenter Integration Service converts numeric constants in any expression function to Decimal. If you do not enable high precision, the PowerCenter Integration Service converts numeric constants to Double.
When you enable high precision, the Data Integration Service converts numeric constants in any expression function to Decimal. If you do not enable high precision, the Data Integration Service converts numeric constants to Double.
When you enable high precision, the Data Integration Service converts numeric constants in any expression function to Decimal. If you do not enable high precision, the Data Integration Service converts numeric constants to Double.
You can ensure the maximum precision for numeric values greater than 28 or 38 digits depending on the transformation. Before you perform any calculations or transformations with the transformation functions, truncate or round any large numbers.
For transformations that support Decimal data type of precision up to 38 digits, use the Decimal data type and enable high precision to ensure precision of up to 38 digits.
For transformations that support Decimal data type of precision up to 38 digits, use the Decimal data type and enable high precision to ensure precision of up to 38 digits.
For transformations that support Decimal data type of precision up to 28 digits, use the Decimal data type and enable high precision to ensure precision of up to 28 digits.
Do not use the Double data type for data that you use in an equality condition, such as a lookup or join condition.
Do not use the Double data type for data that you use in an equality condition, such as a lookup or join condition.
Do not use the Double data type for data that you use in an equality condition, such as a lookup or join condition.


Updated July 02, 2020