Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Google BigQuery
  3. PowerExchange for Google BigQuery Configuration
  4. Configuring HTTP Proxy Options
  5. Google BigQuery Connections
  6. PowerExchange for Google BigQuery Data Objects
  7. PowerExchange for Google BigQuery Mappings
  8. Google BigQuery Lookup
  9. Google BigQuery Run-Time Processing
  10. Appendix A: Google BigQuery Data Type Reference

PowerExchange for Google BigQuery User Guide

PowerExchange for Google BigQuery User Guide

Google BigQuery Data Object Overview

Google BigQuery Data Object Overview

A Google BigQuery data object is a physical data object that uses Google BigQuery as a source or target. A Google BigQuery data object is a physical data object that represents data based on a Google BigQuery resource.
You can configure the data object read and write operation properties that determine how you can read data from Google BigQuery sources and load data to Google BigQuery targets.
Create a Google BigQuery data object from the Developer tool. You can configure the data object read, and write operation properties that determine how the Data Integration Service reads data from Google BigQuery sources and loads data to Google BigQuery targets.
To read data from the Google BigQuery, create a data object read operation based on the Google BigQuery data object. Configure the read operation properties to determine how the Data Integration Service must read data from the Google BigQuery table. Add the read operation as a source in a mapping.
To write data to the Google BigQuery, create a data object write operation based on the Google BigQuery data object. Configure the write operation properties to determine how the Data Integration Service must write data to the Google BigQuery. Add the write operation as a Write transformation in a mapping.
You can use a Google BigQuery data object read operation to look up data in a Google BigQuery table. You can add the data object read operation to a mapping as a lookup transformation. You can look up data from a Google BigQuery table in a mapping based on a lookup condition. You can configure a cached lookup operation to cache the lookup table on the Spark engine and an uncached lookup operation in the native environment.
You can create read-only views in the native environment in Google BigQuery. Views in Google BigQuery are virtual tables generated from a stored query. When you query a view table, you can view the data and fields specified in the query of the view.
Use Google BigQuery to create one of the following types of views:
  • Legacy
  • Standard
Legacy view uses Legacy SQL dialect in BigQuery. Standard SQL uses GoogleSQL that offers more functionalities than Legacy SQL.
For a Google BigQuery source, you can create views to import the view of the object. Use views to preview the source data of the view. Use views with custom query, parameter, and key-range partitioning. You can preview table with advanced properties, such as SQL override, cached or uncached lookup, or a key-range partitioned source.

0 COMMENTS

We’d like to hear from you!