Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Google BigQuery
  3. PowerExchange for Google BigQuery Configuration
  4. Google BigQuery Sources and Targets
  5. Google BigQuery Mappings
  6. Google BigQuery Sessions
  7. Google BigQuery as CDC Target
  8. Google BigQuery Pushdown Optimization
  9. Appendix A: Google BigQuery Data Type Reference

PowerExchange for Google BigQuery User Guide for PowerCenter

PowerExchange for Google BigQuery User Guide for PowerCenter

Read Modes

Read Modes

When you use PowerExchange for Google BigQuery, you can read data by using direct mode or staging mode. Before you choose a mode, see the Google documentation to understand the cost implications and trade-offs for each mode.
You can read data from a Google BigQuery source by using one of the following modes:
Direct Mode
Use direct mode when the volume of data that you want to read is small. In direct mode, PowerExchange for Google BigQuery directly reads data from a Google BigQuery source. You can configure the number of rows that you want PowerExchange for Google BigQuery to read in one request.
Staging Mode
Use staging mode when you want to read large volumes of data in a cost-efficient manner.
In staging mode, PowerExchange for Google BigQuery first exports the data from the Google BigQuery source into Google Cloud Storage. After the export is complete, PowerExchange for Google BigQuery downloads the data from Google Cloud Storage into a local stage file. You can configure the local stage file directory in the advanced source properties. PowerExchange for Google BigQuery then reads the data from the local stage file.
When you enable staging file compression, PowerExchange for Google BigQuery compresses the size of the staging file in Google Cloud Storage. PowerExchange for Google BigQuery then downloads the staging file and decompresses the staging file before it reads the file. To improve the performance and download data in parallel, you can configure the number of threads for downloading the staging file.

0 COMMENTS

We’d like to hear from you!