Table of Contents

Search

  1. Preface
  2. Part 1: Introduction to Google BigQuery connectors
  3. Part 2: Data Integration with Google BigQuery V2 Connector
  4. Part 3: Data Integration with Google BigQuery Connector

Google BigQuery Connectors

Google BigQuery Connectors

Rules and guidelines in mappings in SQL ELT mode

Rules and guidelines in mappings in SQL ELT mode

Consider the following rules and guidelines when you run mappings in SQL ELT mode:
General guidelines
  • You can use different connections for the Source and Lookup transformations. The Source transformation can use a Google BigQuery V2, Google Cloud Storage V2, or Amazon S3 V2 connection, while the Lookup transformation can use a Google BigQuery V2 connection.
Sources
  • When you parameterize the source in a mapping, you cannot set
    Query
    as the source type.
Data types
  • When you read from and write to
    Google BigQuery
    , ensure that the source data doesn't contain BigNumeric, Boolean, Date, DateTime, Record, Repeat, and Time data types.
  • When you configure the expression output to return the decimal data type, the SQL ELT query adds the TRUNC function to provide the output.
Functions
  • You cannot use the function name as the expression output field name, source field name, or target field name.
  • You cannot configure nested Window functions in a mapping.
  • When you use the REGEXP_EXTRACT function in an Expression or Aggregator transformation, the mapping fails if the argument uses the Byte data type and the return type is the String data type.
    To run the mapping successfully, update the data types in the argument and return type of the REGEXP_EXTRACT function to compatible formats.
  • To configure the Window functions in an Expression transformation, you need to select the
    Enable window properties
    check box on the Window tab.

0 COMMENTS

We’d like to hear from you!