Network
Data Engineering
Data Engineering Integration
Enterprise Data Catalog
Enterprise Data Preparation
Cloud Integration
Cloud Application Integration
Cloud Data Integration
Cloud Customer 360
DiscoveryIQ
Cloud Data Wizard
Informatica for AWS
Informatica for Microsoft
Cloud Integration Hub
Complex Event Processing
Proactive Healthcare Decision Management
Proactive Monitoring
Real-Time Alert Manager
Rule Point
Data Integration
B2B Data Exchange
B2B Data Transformation
Data Integration Hub
Data Replication
Data Services
Data Validation Option
Fast Clone
Informatica Platform
Metadata Manager
PowerCenter
PowerCenter Express
PowerExchange
PowerExchange Adapters
Data Quality
Axon Data Governance
Data as a Service
Data Explorer
Data Quality
Data Security Group (Formerly ILM)
Data Archive
Data Centric Security
Secure@Source
Secure Testing
Master Data Management
Identity Resolution
MDM - Relate 360
Multidomain MDM
MDM Registry Edition
Process Automation
ActiveVOS
Process Automation
Product Information Management
Informatica Procurement
MDM - Product 360
Ultra Messaging
Ultra Messaging Options
Ultra Messaging Persistence Edition
Ultra Messaging Queuing Edition
Ultra Messaging Streaming Edition
Edge Data Streaming
Knowledge Base
Resources
PAM (Product Availability Matrices)
Support TV
Velocity (Best Practices)
Mapping Templates
Debugging Tools
User Groups
Documentation
English
English
English
Español
Spanish
Deutsch
German
Français
French
日本語
Japanese
한국어
Korean
Português
Portuguese
中文
Chinese
Log Out
Data Engineering Streaming
10.2.1
10.5.2
10.5.1
10.5
10.4.1
10.4.0
10.2.2 Service Pack 1
10.2.2
10.2.1
10.2 HotFix 2
10.2 HotFix 1
10.2
H2L
Big Data Streaming User Guide
Data Engineering Streaming 10.2.1
Data Engineering Streaming 10.2.1
All Products
Rename Saved Search
Name
* This field is required
Overwrite saved search
Confirm Deletion
Are you sure you want to delete the saved search?
Table of Contents
Search
No Results
Preface
Introduction to Big Data Streaming
Big Data Streaming Overview
Streaming Process
Component Architecture
Clients and Tools
Application Services
Repository
Third-Party Applications
Example
Big Data Streaming Configuration
Big Data Streaming Configuration Overview
Supported Hadoop Distributions
Prerequisites to Read From or Write to a Kerberised Kafka Cluster
Download the JDBC Drivers for Sqoop Connectivity
High Availability Prerequisites
Update Connection Properties
Sources in a Streaming Mapping
Sources in a Streaming Mapping Overview
Processing Hierarchical Data in Streaming Mappings
AmazonKinesis Data Objects
AmazonKinesis Data Object Overview Properties
AmazonKinesis Data Object Read Operation Properties
General Properties
Ports Properties
Sources Properties
Run-time Properties
Advanced Properties
Column Projections Properties
Configuring Scheme for Flat Files
Azure EventHub Data Objects
Azure EventHub Data Object Overview Properties
Azure Eventhub Data Object Read Operation Properties
General Properties
Ports Properties
Sources Properties
Run-time Properties
Advanced Properties
Column Projections Properties
HBase Data Objects
HBase Data Object Read Operation Properties
JMS Data Objects
Integration with JMS
JMS Message Structure
Header Fields
Property Fields
Body Fields
JMS Data Object Overview Properties
JMS Data Object Read Operation Properties
General Properties
Ports Properties
Sources Properties
Run-time Properties
Advanced Properties
Column Projections Properties
Configuring a Schema for Flat Files
Kafka Data Objects
Kafka Data Object Overview Properties
Kafka Data Object Read Operation Properties
General Properties
Ports Properties
Run-time Properties
Advanced Properties
Sources Properties
Column Projection Properties
Configuring Schema for Flat Files
MapR Streams Data Objects
MapRStreams Object Overview Properties
MapRStreams Data Object Read Operation Properties
General Properties
Ports Properties
Sources Properties
Run-time Properties
Advanced Properties
Column Projections Properties
Targets in a Streaming Mapping
Targets in a Streaming Mapping Overview
Processing Hierarchical Data in Streaming Mappings
AmazonKinesis Data Objects
AmazonKinesis Data Object Overview Properties
AmazonKinesis Data Object Write Operation Properties
General Properties
Ports Properties
Target Properties
Run-time Properties
Advanced Properties
Column Projection Properties
Azure EventHub Data Objects
Azure EventHub Data Object Overview Properties
Azure EventHub Data Object Write Operations
General Properties
Ports Properties
Target Properties
Run-time Properties
Advanced Properties
Column Projections Properties
Complex File Data Objects
Complex File Data Object Overview Properties
Compression and Decompression for Complex File Targets
Complex File Data Object Write Operation Properties
General Properties
Ports Properties
Target Properties
Run-time Properties
Advanced Properties
Column Projection Properties
Complex File Execution Parameters
HBase Data Objects
Data Object Column Configuration
Add Columns
Search and Add Columns
Get All Columns
HBase Object Overview Properties
HBase Data Object Write Operation Properties
Advanced Properties
JMS Data Objects
Integration with JMS
JMS Message Structure
Header Fields
Property Fields
Body Fields
JMS Data Object Overview Properties
JMS Data Object Write Operation Properties
General Properties
Ports Properties
Target Properties
Run-time Properties
Advanced Properties
Column Projections Properties
Kafka Data Objects
Kafka Data Object Overview Properties
Kafka Data Object Write Operation Properties
General Properties
Ports Properties
Run-time Properties
Target Properties
Advanced Properties
Column Projections Properties
Microsoft Azure Data Lake Store Data Object
Microsoft Azure Data Lake Store Data Object Properties
Microsoft Azure Data Lake Store Data Object Write Operation Properties
Input Properties of the Data Object Write Operation
Ports Properties - Input Write
Run-time Properties
Advanced Properties
Column Projection Properties
MapRStreams Data Objects
MapRStreams Object Overview Properties
MapRStreams Data Object Write Operation Properties
General Properties
Port Properties
Target Properties
Run-time Properties
Column Projection Properties
Relational Data Objects
Relational Data Object Overview Properties
Relational Data Object Write Operation Properties
General Properties
Data Object Properties
Ports Properties
Run-time Properties
Advanced Properties
Streaming Mappings
Streaming Mappings Overview
Connections
Data Objects
Creating a Data Object
Creating a Data Object Operation
Transformations in a Streaming Mapping
Stateful Computing
Partitioning Configuration
Example
Rules in a Streaming Mapping
Mapping Configurations
Mapping Validation
Environment Validation
Data Object Validation
Transformation Validation
Run-time Validation
Monitor Jobs
Streaming Mapping Example
High Availability Configuration
Troubleshooting Streaming Mappings
Window Transformation
Window Transformation Overview
Window Transformation Types
Tumbling Window
Sliding Window
Window Transformation Window Properties
Tumbling Window Transformation Example
Sliding Window Transformation Example
Rules and Guidelines for Transformations
Appendix A: Connections
Connections Overview
AmazonKinesis Connection
Prerequisites
General Properties
Connection Properties
Creating an AmazonKinesis Connection using Informatica Command Line Program
Azure EventHub Connection
Prerequisites
General Properties
Connection Properties
Creating an Azure EventHub Connection using Informatica Command Line Program
HBase Connection
General Properties
Connection Properties
Creating an HBASE Connection using Informatica Command Line Program
HDFS Connection
General Properties
Connection Properties
Creating an HDFS Connection using Informatica Command Line Program
Hive Connection
Creating a Hive Connection using Informatica Command Line Program
JMS Connection
Prerequisites to Create a JMS Connection and a JMS Data Object
Prerequisites to Use a JMS Connection and a JMS Data Object
General Properties
Connection Properties
Creating a JMS Connection using Informatica Command Line Program
JDBC Connection Properties
Kafka Connection
General Properties
Kafka Broker Properties
Creating a Kafka Connection using Informatica Command Line Program
MapRStreams Connection
General Properties
Connection Properties
Creating a MapRStreams Connection using Informatica Command Line Program
Microsoft Azure Data Lake Store Connection
Microsoft Azure Data Lake Store Connection Properties
Appendix B: Data Type Reference
Data Type Reference Overview
Complex File Formats and Transformation Data Types
Avro Data Types
Flat Data Types
JSON Data Types
XML Data Types
Sqoop Data Types
Microsoft SQL Server Data Types
Oracle Data Types
Appendix C: Sample Files
Sample Files
Sample XSD File
Sample JSON Schema
Sample Avro Schema
Sample Flat Format Schema
Big Data Streaming User Guide
Big Data Streaming User Guide
10.2.1
10.5.2
10.5.1
10.5
10.4.1
10.4.0
10.2.2 Service Pack 1
10.2.2
10.2 HotFix 2
10.2 HotFix 1
10.2
Back
Next
HBase Connection
HBase Connection
Create an HBase connection to write data to an HBase table.
You can create and manage an HBase connection in the Developer tool or through infacmd.
Appendix A: Connections
General Properties
Connection Properties
Creating an HBASE Connection using Informatica Command Line Program
Updated April 09, 2022
Download Guide
Send Feedback
Resources
Communities
Knowledge Base
Success Portal
Back to Top
Back
Next
