Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Google BigQuery
  3. PowerExchange for Google BigQuery Configuration
  4. Google BigQuery Sources and Targets
  5. Google BigQuery Mappings
  6. Google BigQuery Sessions
  7. Google BigQuery as CDC Target
  8. Google BigQuery Pushdown Optimization
  9. Appendix A: Google BigQuery Data Type Reference

PowerExchange for Google BigQuery User Guide for PowerCenter

PowerExchange for Google BigQuery User Guide for PowerCenter

Rules and Guidelines for Google BigQuery Connection Modes

Rules and Guidelines for Google BigQuery Connection Modes

Simple Mode

Consider the following rules and guidelines when you configure a Google BigQuery connection to use simple connection mode:
  • If the Google BigQuery source table contains repeated columns, you cannot configure source filters for these columns.
  • If the Google BigQuery table contains more than one repeated column, you cannot preview data.
  • If the Google BigQuery target table contains columns of the Record data type and repeated columns, you cannot configure update, upsert, and delete operations for these columns.
  • If the Google BigQuery target table contains columns that are marked as required in Google BigQuery, you cannot configure upsert operation for these columns.
  • You can configure upsert operation on columns of primitive data types in the Google BigQuery table.
  • When you configure an upsert operation, you cannot perform update operation on multiple rows in the Google BigQuery target.
  • When you read data from a Google BigQuery source, you must not map more than one repeated column in a single mapping. You must create multiple mappings for each repeated column.

Hybrid Mode

Consider the following rules and guidelines when you configure a Google BigQuery connection to use hybrid connection mode:
  • If the Google BigQuery source table contains columns of the Record data type and repeated columns, you cannot configure source filters for these columns.
  • You cannot configure update, upsert, and delete operations for columns of the Record data type and repeated columns.
  • You must select JSON (Newline Delimited) format as the data format of the staging file under the target session properties. You can use CSV format as the data format of the staging file only when the Google BigQuery table does not contain columns of the Record data type or repeated columns.
  • The following CSV formatting options in the target session properties are not applicable:
    • Allow Quoted Newlines
    • Field Delimiter
    • Allow Jagged Rows

Complex Mode

Consider the following rules and guidelines when you configure a Google BigQuery connection to use complex connection mode:
  • When you configure a Google BigQuery source connection to use complex connection mode, you cannot configure data filters for the source.
  • You cannot configure update, upsert, and delete operations.
  • You must select JSON (Newline Delimited) format as the data format of the staging file under the target session properties.
  • You cannot use CSV format as the data format of the staging file. The following CSV formatting options in the target session properties are not applicable:
    • Allow Quoted Newlines
    • Field Delimiter
    • Allow Jagged Rows

0 COMMENTS

We’d like to hear from you!