Table of Contents

Search

  1. Preface
  2. Introduction to Big Data Streaming
  3. Big Data Streaming Configuration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Window Transformation
  8. Appendix A: Connections
  9. Appendix B: Data Type Reference
  10. Appendix C: Sample Files

Big Data Streaming User Guide

Big Data Streaming User Guide

XML Data Types

XML Data Types

The following table lists the XML data types that Data Integration Service supports and the corresponding transformation data types:
Native XML DataType
Transformation Data Type
Range and Description
anyURI
string
1 to 255 characters
array
array
The elements in the array are of string, double, or int data type. The elements in the array are delimited by commas. For example, an array of fruits is represented as [apple,banana,orange]
boolean
integer
The default transformation type for boolean is integer. You can specify string data type with values of True and False. True is equivalent to the integer 1 and False is equivalent to the integer 0.
byte
integer
-2,147,483,648 to 2,147,483,647 Precision 10, scale 0
date
date/time
The time stamp format is YYYY-MM-DD HH:MM:SS.SSS. Precision 29, scale 9.
dateTime
date/time
The time stamp format is YYYY-MM-DD HH:MM:SS.SSS. Precision 29, scale 9.
decimal
double
-1.79769313486231570E+308 to +1.79769313486231570E+308. Precision 15
double
double
-1.79769313486231570E+308 to +1.79769313486231570E+308. Precision 15
everythingElse
string
1 to 255 characters
float
double
-1.79769313486231570E+308 to +1.79769313486231570E+308. Precision 15
integer
integer
-2,147,483,648 to 2,147,483,647 Precision 10, scale 0
int
integer
-2,147,483,648 to 2,147,483,647 Precision 10, scale 0
long
bigint
-9,223,372,036,854,775,808 to 9,223,372,036,854,775,807 Precision 19, scale 0
nonPositiveInteger
integer
-2,147,483,648 to 2,147,483,647 Precision 10, scale 0
negativeInteger
integer
-2,147,483,648 to 2,147,483,647 Precision 10, scale 0
nonNegativeInteger
integer
-2,147,483,648 to 2,147,483,647 Precision 10, scale 0
positiveInteger
integer
-2,147,483,648 to 2,147,483,647 Precision 10, scale 0
QName
string
1 to 255 characters
short
integer
-2,147,483,648 to 2,147,483,647 Precision 10, scale 0
string
string
1 to 255 characters
struct
struct
Structs are represented as pairs of strings and integers delimited by the : character. String and integer pairs are delimited by commas. For example, a struct of fruits is represented as [1,apple]
time
string
1 to 255 characters
unsignedInt
integer
-2,147,483,648 to 2,147,483,647 Precision 10, scale 0
unsignedShort
integer
-2,147,483,648 to 2,147,483,647 Precision 10, scale 0
unsignedByte
integer
-2,147,483,648 to 2,147,483,647 Precision 10, scale 0
unsignedLong
bigint
-9,223,372,036,854,775,808 to 9,223,372,036,854,775,807 Precision 19, scale 0
If you have multiple date and time formats in the data payload that you read from, they must be must be converted to Date/Time data type. Get the date and time stamp data in string format and then use an expression transformation to convert the string to Date/Time.
For example, the following expression converts the string in the
shipment_date
port to a date value:
TO_DATE(shipment_date,'YYYY-MM-DD')
The Data Integration Service uses the following default date/time format of applications:
MM/DD/YYYY HH24:MI:SS
You can set this property on the
Advanced
tab of the application, when the application contains a mapping.
You can set Default date time format property for the Data Integration Service in the
Preferences
Informatica
Run Configurations
Mapping
Advanced
tab.
When you perform a lookup on timestamp data or write timestamp data to a target in a Streaming mapping, the Spark engine reads or writes the time only up to the microseconds. This occurs because the default size of the timestamp field is 8 bytes.

0 COMMENTS

We’d like to hear from you!