Table of Contents

Search

  1. Preface
  2. Part 1: Introduction to Google BigQuery connectors
  3. Part 2: Data Integration with Google BigQuery V2 Connector
  4. Part 3: Data Integration with Google BigQuery Connector

Google BigQuery Connectors

Google BigQuery Connectors

Data filters

Data filters

You can create simple or advanced data filters. You can also create a set of data filters for each object included in a
mapping
task. Each set of data filters act independently of the other sets.
You can create simple or advanced data filters for the following data types:
  • Integer
  • Float
  • Numeric (only if you use a Google BigQuery connection in hybrid mode)
  • String
  • Timestamp
When you create simple or advanced data filters for columns of Numeric data type, ensure that you use a
Google BigQuery V2
connection in hybrid connection mode.
You can only configure simple filters for mappings in advanced mode.

Simple data filters

You can create one or more simple data filters. When you create multiple simple data filters, the associated task creates an AND operator between the filters and loads rows that apply to all simple data filters.

Advanced data filters

You can create an advanced data filter to create complex expressions that use AND, OR, or nested conditions. The expression that you enter becomes the WHERE clause in the query used to retrieve records from the source.
Use the following formats to define a filter field in an advanced data filter:
  • <fieldName>
  • <projectName>.<datasetName>.<tableName>.<fieldName>
If the Google BigQuery dataset name begins with a number, use the following format to define a filter field in an advanced data filter:
<projectName>.'<datasetName>'.<tableName>.<fieldName>

0 COMMENTS

We’d like to hear from you!