Table of Contents

Search

  1. Preface
  2. Part 1: Introduction to Google BigQuery connectors
  3. Part 2: Data Integration with Google BigQuery V2 Connector
  4. Part 3: Data Integration with Google BigQuery Connector

Google BigQuery Connectors

Google BigQuery Connectors

Rules and guidelines for adding multiple source objects

Rules and guidelines for adding multiple source objects

Consider the following rules and guidelines when you add multiple source objects:
  • When you import multiple source tables, ensure that you use a Google BigQuery V2 connection in hybrid mode.
  • You cannot configure partitioning when you use the advanced relationship option.
  • You must not import multiple source tables with the same name from different datasets.
  • You cannot use a self join when you add multiple source tables.
  • When you specify a cross join condition to read data from multiple Google BigQuery tables, use the following format:
    project_id.datasetname.tablename CROSS JOIN project_id.datasetname.tablename
  • When you configure a Filter transformation, you must not apply a filter condition with the column of Record data type in the source object.
  • When you configure a Joiner or Router transformation, you must not apply a condition with the column of Record data type in the source object.
  • When you configure a mapping to read data from multiple sources, ensure that the source objects does not contain columns of Record data type or Repeated columns with the same name. Otherwise, the mapping fails with the following error:
    com.google.cloud.hadoop.repackaged.bigquery.com.google.api.client.googleapis.json. GoogleJsonResponseException: 400 Bad Request
  • When you use special characters in column names for an advanced relationship, the query generated is not valid and the mapping task fails.
  • When you click
    Add Object
    to add more objects in the
    Advanced Relationship
    window, the table might fail to load or take a long time to load. If this issue occurs, import the object again.

0 COMMENTS

We’d like to hear from you!