User Guide

10.5.1
- 10.5.4
- 10.5.2
- 10.5
- 10.4.1
- 10.4.0
- 10.2.2 Service Pack 1
- 10.2.2
- 10.2.1

Back Next

Run-time Properties

The run-time properties display the name of the connection.

The following table describes the run-time property that you configure for Google PubSub sources:

Property	Description
Connection	Name of the Google PubSub connection.
Partition Type	Select the partition type. You can select either None or Fixed. To configure fixed partitioning, specify the number of partitions that the Spark Engine creates at runtime. The number of partitions can be equal to the number of CPU cores allocated to the executors. Informatica recommends to increase the number of partitions to increase parallel pull requests. For example, setting spark.executor.instances to 10 and spark.executor.cores to 2, allocates 20 cores. Set the number of partitions to 20 to create 20 parallel pull requests to read from the Google PubSub source.

Property

Description

Connection

Name of the Google PubSub connection.

Partition Type

Select the partition type.

You can select either None or Fixed. To configure fixed partitioning, specify the number of partitions that the Spark Engine creates at runtime.

The number of partitions can be equal to the number of CPU cores allocated to the executors. Informatica recommends to increase the number of partitions to increase parallel pull requests. For example, setting

spark.executor.instances

to 10 and

spark.executor.cores

to 2, allocates 20 cores. Set the number of partitions to 20 to create 20 parallel pull requests to read from the Google PubSub source.

Google PubSub Data Object Read Properties

Download Guide

Watch

Comments

Communities

Knowledge Base

Success Portal