Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Connections
  4. Mappings in a Hadoop Environment
  5. Mappings in the Native Environment
  6. Profiles
  7. Native Environment Optimization
  8. POWERCENTERHELP
  9. Data Type Reference

Hive Sources

Hive Sources

Hive sources are valid in mappings in a Hadoop environment with some restrictions.
Hive sources are valid in mappings in a Hadoop environment with the following restrictions:
  • The Data Integration Service can run pre-mapping SQL commands against the source database before it reads from a Hive source. When you run a mapping with a Hive source in a Hadoop environment, references to local path in pre-mapping SQL commands are relative to the Data Integration Service node. When you run a mapping with a Hive source in the native environment, references to local path in pre-mapping SQL commands are relative to the Hive server node.
  • A mapping fails to validate when you configure post-mapping SQL commands. The Data Integration Service does not run post-mapping SQL commands against a Hive source.
  • A mapping fails to run when you have Unicode characters in a Hive source definition.
  • When you run a mapping with a Hive source in the native environment, the Data Integration Service converts decimal values with precision greater than 28 digits to double values.
  • When you import Hive tables with Decimal data type into the Developer tool, the Decimal data type precision is set as 38 and the scale is set as 0. This occurs because the third-party Hive JDBC driver does not return the correct precision and scale values for the Decimal data type. For Hive tables on Hive 0.11 and Hive 0.12, accept the default precision and scale for the Decimal data type set by the Developer tool. For Hive tables on Hive 0.12 with Cloudera CDH 5.0, and Hive 0.13 and above, you can configure the precision and scale fields for source columns with the Decimal data type in the Developer tool. For Hive tables on Hive 0.14 or above, the precision and scale used for the Decimal data type in the Hive database also appears in the Developer tool.


Updated July 03, 2018