Table of Contents

Search

  1. Preface
  2. Part 1: Introduction to Google BigQuery connectors
  3. Part 2: Data Integration with Google BigQuery V2 Connector
  4. Part 3: Data Integration with Google BigQuery Connector

Google BigQuery Connectors

Google BigQuery Connectors

Target functionality

Target functionality

When you import an object from Google BigQuery to write data, you can configure the advance target properties to determine the write operation behavior. For example, you can write data in streaming mode or you can retain Google Cloud Storage staging files after the write operation is complete using bulk mode.
The following table lists the target functionality you can use when you write data to a Google BigQuery target:
Target functionality
Google BigQuery mapping
Google BigQuery V2 mapping
Write mode - bulk
Yes
Yes
Specify optional custom properties in connection
No
Yes
Create disposition
Yes
Yes
Write disposition
Yes
Yes
Region ID
No
Yes
Staging file in Google Cloud Storage
Yes
Yes
Persist staging file after writing to Google BigQuery
Yes
Yes
Staging file directory
Yes
Yes
Write mode - streaming
Yes
Yes
Write mode - CDC
No
Yes
Use merge query for update, upsert, and delete operations
No
Yes
Streaming template table suffix
Yes
Yes
Rows per streaming request
Yes
Yes
Staging file compression
Yes
Yes
Job poll interval
Yes
Yes
Multiple threads for uploading staging file
Yes
Yes
Allow quoted newlines
Yes
Yes
Field delimiter
Yes
Yes
Quote character
Yes
Yes
Allow jagged rows
Yes
Yes
Pre-SQL and pre-SQL configurations
Yes
Yes
Post-SQL and post-SQL configurations
Yes
Yes
Enable Merge
No
Yes
Update Override
No
Yes
Truncate target table
No
Yes

0 COMMENTS

We’d like to hear from you!