Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Streaming
  3. Data Engineering Streaming Administration
  4. Sources in a Streaming Mapping
  5. Targets in a Streaming Mapping
  6. Streaming Mappings
  7. Window Transformation
  8. Appendix A: Connections
  9. Appendix B: Monitoring REST API Reference
  10. Appendix C: Sample Files

Targets in a Streaming Mapping on Hadoop

Targets in a Streaming Mapping on Hadoop

A streaming mapping that runs in the Hadoop environment can include file, database, and streaming targets.
Based on the type of target you are write to, you can create the following data objects:
Amazon Kinesis
A physical data object that represents data in an Amazon Kinesis Firehose Delivery Stream. Create an Amazon Kinesis data object to write to an Amazon Kinesis Firehose Delivery Stream.
Amazon S3
A physical data object that represents data in an Amazon S3 resource. Create an Amazon S3 data object to write data to an Amazon S3 target.
Azure Event Hub
A physical data object that represents data in Microsoft Azure Event Hubs data streaming platform and event ingestion service. Create an Azure Even Hub data object to connect to an Event Hub target.
Complex file
A representation of a file in the Hadoop file system. Create a complex file data object to write data to an HDFS sequence file or binary file.
For more information about complex file data objects, see the
Data Engineering Integration User Guide
.
Confluent Kafka
A physical data object that can access Kafka brokers and Confluent Kafka brokers. Create a Confluent Kafka data object to write to a Kafka broker or to a Confluent Kafka broker using schema registry.
HBase
A physical data object that represents data in an HBase resource. Create an HBase data object to connect to an HBase data target.
JMS
A physical data object that accesses a JMS server. Create a JMS data object to write to a JMS server.
Kafka
A physical data object that accesses a Kafka broker. Create a Kafka data object to write to a Kafka broker.
MapR Streams
A MapR Streams data object is a physical data object that represents data in a MapR Stream. Create a MapR Streams data object to write to a MapR Stream.
Microsoft Azure Data Lake
A Microsoft Azure Data Lake Store data object is a physical data object that represents a Microsoft Azure Data Lake Store table. Create an Azure Data Lake object to write to a Microsoft Azure Data Lake Store table.
Relational
A physical data object that you can use to access a relational table. You can create a relational object to connect to a Hive or JDBC-compliant database.
For more information about relational data objects, see the
Informatica Developer Tool Guide
.
Snowflake
A physical data object that represents data in a Snowflake resource. Create a Snowfalke data object to write data to a Snowflake target.
Effective in version 10.4.0, Snowflake is available for technical preview. Technical preview functionality is supported for evaluation purposes but is unwarranted and is not production-ready. Informatica recommends that you use in non-production environments only. Informatica intends to include the preview functionality in an upcoming release for production use, but might choose not to in accordance with changing market or technical circumstances. For more information, contact Informatica Global Customer Support.

0 COMMENTS

We’d like to hear from you!