Table of Contents

Search

  1. Preface
  2. Introduction to Data Engineering Administration
  3. Authentication
  4. Running Mappings on a Cluster with Kerberos Authentication
  5. Authorization
  6. Cluster Configuration
  7. Cloud Provisioning Configuration
  8. Data Integration Service Processing
  9. Appendix A: Connections Reference
  10. Appendix B: Monitoring REST API

Google BigQuery Connection Properties

Google BigQuery Connection Properties

When you set up a Google BigQuery connection, you must configure the connection properties.
The order of the connection properties might vary depending on the tool where you view them.
The following table describes the Google BigQuery connection properties:
Property
Description
Service Account ID
Specifies the client_email value present in the JSON file that you download after you create a service account in Google BigQuery.
Service Account Key
Specifies the private_key value present in the JSON file that you download after you create a service account in Google BigQuery.
Connection mode
The mode that you want to use to read data from or write data to Google BigQuery.
Select one of the following connection modes:
  • Simple. Flattens each field within the Record data type field as a separate field in the mapping.
  • Hybrid. Displays all the top-level fields in the Google BigQuery table including Record data type fields. PowerExchange for Google BigQuery displays the top-level Record data type field as a single field of the String data type in the mapping.
  • Complex. Displays all the columns in the Google BigQuery table as a single field of the String data type in the mapping.
Default is Simple.
Schema Definition File Path
Specifies a directory on the client machine where the must create a JSON file with the sample schema of the Google BigQuery table. The JSON file name is the same as the Google BigQuery table name.
Alternatively, you can specify a storage path in Google Cloud Storage where the must create a JSON file with the sample schema of the Google BigQuery table. You can download the JSON file from the specified storage path in Google Cloud Storage to a local machine.
Project ID
Specifies the project_id value present in the JSON file that you download after you create a service account in Google BigQuery.
If you have created multiple projects with the same service account, enter the ID of the project that contains the dataset that you want to connect to.
Storage Path
This property applies when you read or write large volumes of data.
Path in Google Cloud Storage where the creates a local stage file to store the data temporarily.
You can either enter the bucket name or the bucket name and folder name.
For example, enter
gs://<bucket_name>
or
gs://<bucket_name>/<folder_name>
Dataset ID
Not applicable for PowerExchange for Google BigQuery.
Use Legacy SQL For Custom Query
Not applicable for PowerExchange for Google BigQuery.
Dataset Name for Custom Query
Not applicable for PowerExchange for Google BigQuery.

0 COMMENTS

We’d like to hear from you!