Rules and guidelines for Google BigQuery V2 CDC target
Rules and guidelines for Google BigQuery V2 CDC target
Consider the following guidelines when working with a Google BigQuery V2 change data capture (CDC) target:
Informatica recommends that the Secure Agent, the CDC source, and PowerExchange for CDC are configured in the same region as Google BigQuery.
To increase performance and avoid run-time environment memory issues, increase the Java heap size in the JVM option for type DTM. Set JVMOption1 to -Xmx1024m in the
System Configuration Details
section of the Secure Agent and restart the Secure Agent.
To improve performance, specify a higher commit interval for the
Maximum Rows Per Commit
property on the CDC Runtime page in the mapping task wizard. However, in case of failure, recovery takes more time for a higher commit interval.
It is recommended to use update queries on the CDC source database only if the Google BigQuery target table is partitioned and clustered.
You must define a column as required in the Google BigQuery target table.
If you define a column as required in the Google BigQuery target table, you must map a column in the CDC source to the required column in the Google BigQuery target in the mapping.
When you use a Google BigQuery V2 connection in complex mode, you cannot write changed data from a CDC source to a Google BigQuery V2 target.
When you capture changed data from a CDC source and the Google BigQuery V2 target contains a repeated column of the Record data type, the mapping fails.