Table of Contents

Search

  1. Preface
  2. Informatica Intelligent Cloud Services REST API
  3. Platform REST API version 2 resources
  4. Platform REST API version 3 resources
  5. Data Integration REST API
  6. Mass Ingestion Files REST API
  7. Mass Ingestion Streaming REST API
  8. RunAJob utility
  9. ParamSetCli utility
  10. REST API codes
  11. REST API resource quick references

REST API Reference

REST API Reference

Connection configuration for tasks with Kafka as a source and as a target

Connection configuration for tasks with Kafka as a source and as a target

When the source and target connection of the task is Kafka, you can include the following fields and key-value pairs in the config array of the source and target connection:
Key
Type
Required
Description
Topic
String
Yes
Kafka source topic name or a Java supported regular expression for the Kafka source topic name pattern to read the events from.
Enter a string of up to 249 characters.
consumerProperties
String
-
Provide a comma-separated list of optional consumer configuration properties. Specify the values as key-value pairs. For example,
key1=value1, key2=value2
.
You can enter a string of up to 4000 characters.
producerProperties
String
-
The configuration properties for the producer.
Provide a comma-separated list and specify the values as key-value pairs.
You can enter a string of up to 4000 characters.
mdFetchTimeout
Integer
-
The time after which the metadata is not fetched.
Enter a value between 1 and 2147483647.
batchSize
Integer
-
The batch size of the events after which a streaming ingestion task writes data to the target.
Enter a value between 1 and 2147483647.
Topic Name/Expression
String
Yes
Kafka topic name or a Java supported regular expression for the Kafka topic name pattern.
You can enter a string of up to 249 characters.

POST request example

To update a
streaming ingestion
task with a Kafka source and target, you might send a request similar to the following example:
{ "name": "kafka to kafka", "description": "kafka to kafka", "runtimeId": "01000025000000000003", "locationId": "5sJ0JDyJyWLlrosS5qJjsQ", "currentVersion": "2", "messageFormat": "binary", "nodes": [ { "name": "kafka to kafka_source", "type": "source", "connectionId": "012MGS0B000000000002", "transformationType": "", "config": [ { "key": "consumerProperties", "value": "key=value" }, { "key": "Topic", "value": "test" } ] }, { "name": "kafka to kafka_target", "type": "target", "connectionId": "012MGS0B000000000002", "transformationType": "", "config": [ { "key": "producerProperties", "value": "key=value" }, { "key": "mdFetchTimeout", "value": 5000 }, { "key": "batchSize", "value": 1048576 }, { "key": "Topic Name/Expression", "value": "test" } ] } ], "edges": [ { "from": "kafka to kafka_source", "to": "kafka to kafka_target" } ] }

0 COMMENTS

We’d like to hear from you!