Configuring Pass-through Partitioning for a Google BigQuery Session
Configuring Pass-through Partitioning for a Google BigQuery Session
Configure pass-through partitioning for a Google BigQuery session. After you add the number of partitions, you can specify a filter override condition for each of the partitions. Alternatively, you can specify a SQL override query instead of a filter override condition for each of the partitions. When you configure pass-through partitioning, you can also specify a different staging file directory for each of the partitions.
In the
Workflow Designer
, open the session properties.
In the
Partitions
view, click
Add Partition Point
.
The transformation name appears under the
Partition Points
node.
Select the Source transformation, and click
Edit Partition Point
.
The
Edit Partition Point
dialog box appears.
Click
Add
to add the partitions and enter a description for each partition.
Select the partition type as
Pass Through
for each of the partitions.
Click
OK
.
Click the
Transformations
tab in the session properties.
Based on the number of partitions you create, those many number of partition fields appear for the
Filter Override
,
Local Staging File Directory
,
SQL Override Query
, and
Use Legacy SQL for SQL override
property.
Specify the filter override condition for each partition.
For example, in the following image, you can configure filter override conditions for each of the four partitions configured:
You can also specify local staging file directory for each of the partitions. If you do not specify a local staging file directory for a partition, the PowerCenter Integration Service considers the default staging file directory.
For example, in the following image, you can configure local staging file directory for each of the four partitions configured: