Table of Contents

Search

  1. Preface
  2. Connectors and connections
  3. Connection configuration
  4. Connection properties
  5. Swagger file generation for REST V2 connections

Connections

Connections

Rules and guidelines for Google BigQuery connection modes

Rules and guidelines for Google BigQuery connection modes

Simple mode

Consider the following rules and guidelines when you configure a Google BigQuery connection to use simple connection mode:
  • You cannot create a Google BigQuery target table that contains repeated columns using the
    Create Target
    option.
  • If the Google BigQuery source table contains repeated columns, you cannot configure data filters for these columns.
  • If the Google BigQuery table contains more than one repeated column, you cannot preview data.
  • If the Google BigQuery target table contains repeated columns, you cannot configure update and delete operations for these columns.
  • You cannot configure upsert operations for columns of the Record data type and repeated columns.
  • When you read data from a Google BigQuery source, you must not map more than one repeated column in a single mapping. You must create multiple mappings for each repeated column.

Hybrid mode

Consider the following rules and guidelines when you configure a Google BigQuery connection to use hybrid connection mode:
  • You cannot preview data.
  • You cannot create a Google BigQuery target table using the
    Create Target
    option.
  • If the Google BigQuery source table contains columns of the Record data type and repeated columns, you cannot configure data filters for these columns.
  • You cannot configure update, upsert, and delete operations for columns of the Record data type and repeated columns.
  • You must select JSON (Newline Delimited) format as the data format of the staging file under the advanced target properties. You can use CSV format as the data format of the staging file unless the Google BigQuery table contains columns of the Record data type or repeated columns.
  • The following CSV formatting options in the advanced target properties are not applicable:
    • Allow Quoted Newlines
    • Field Delimiter
    • Allow Jagged Rows

Complex mode

Consider the following rules and guidelines when you configure a Google BigQuery connection to use complex connection mode:
  • You cannot preview data.
  • You cannot create a Google BigQuery target table using the
    Create Target
    option.
  • When you configure a Google BigQuery source connection to use complex connection mode, you cannot configure data filters for the source.
  • You cannot configure update, upsert, and delete operations.
  • You must select JSON (Newline Delimited) format as the data format of the staging file under the advanced target properties.
  • You cannot use CSV format as the data format of the staging file. The following CSV formatting options in the advanced target properties are not applicable:
    • Allow Quoted Newlines
    • Field Delimiter
    • Allow Jagged Rows
  • You cannot use key range partitioning for Google BigQuery sources.

0 COMMENTS

We’d like to hear from you!