Kafka Connector

Kafka Connector

Configure Informatica fixed partitions

Configure Informatica fixed partitions

When you read data from a Kafka source topic in real-time, you can configure Informatica fixed partitioning to optimize the mapping performance at run time.
When you configure Informatica fixed partitions on a Kafka source topic in a mapping, Kafka Connector treats each Informatica partition as an individual consumer within a topic and assigns a specific number of topic partitions to each Informatica partition.
Consider the number of messages to be processed in the mapping to determine an appropriate number of Informatica partitions for the mapping. You can specify up to 64 Informatica partitions.
Consider the following rules and guidelines when you configure Informatica partitions on a Kafka source topic in a mapping:
  • You can only write data to relational targets that can process partitioned data.
  • You cannot write data to a flat file target.
  • After you run a mapping, you must not change the number of Informatica partitions. Otherwise, when you re-run the mapping, the mapping fails and the Secure Agent does not recover the messages in the Kafka topic.
  • You must not configure Informatica partitions for a Kafka topic in an existing mapping that did not contain any partitions initially.

0 COMMENTS

We’d like to hear from you!