Hadoop Files V2 Connector

Back Next

Appendix A: Hadoop Files V2 data type reference

Data Integration

uses complex files in

mapping

tasks with

Hadoop Files

V2 Connector.

Data Integration

uses the following data types in mappings and

mapping

tasks with complex file:

Complex file native data types: Complex native data types appear in the Source and the Target transformations when you choose to edit metadata for the fields.
Transformation data types: Set of data types that appear in the transformations. They are internal data types based on ANSI SQL-92 generic data types, which the Secure Agent uses to move data across platforms. Transformation data types appear in all transformations in a mappings, mass ingestion tasks, and
mapping
tasks.; When
Data Integration
reads source data, it converts the native data types to the comparable transformation data types before transforming the data. When
Data Integration
writes to a target, it converts the transformation data types to the comparable native data types.