Table of Contents

Search

  1. Preface
  2. Part 1: Introduction to Google BigQuery connectors
  3. Part 2: Data Integration with Google BigQuery V2 Connector
  4. Part 3: Data Integration with Google BigQuery Connector

Google BigQuery Connectors

Google BigQuery Connectors

Google BigQuery V2 and transformation data types

Google BigQuery V2 and transformation data types

The following table describes the data types that
Data Integration
supports for Google BigQuery sources and targets:
Google BigQuery Data Type
Transformation Data Type
Range and Description for the Transformation Data Type
BOOLEAN
String
Boolean True or False values.
Default precision is 5.
BIGNUMERIC
String or Decimal
The BigNumeric data type by default maps to the String data type. You can use edit metadata option to map the BigNumeric data type to Decimal data type in the Source and Target transformations.
For String data type:
  • 1 to 104,857,600 characters.
  • Default precision is 255.
  • You can increase the value up to 104,857,600 characters.
For Decimal data type:
  • Precision 28 and scale 9 for the source.
  • Precision 29 and scale 9 for the target.
DATE¹
Date/Time
Date values. Google BigQuery Connector uses the following format:
YYYY-[M]M-[D]D
Minimum value: 0001-01-01
Maximum value: 9999-12-31
Precision 29, scale 9
DATETIME¹
Date/Time
Google BigQuery Connector uses the following format:
YYYY-[M]M-[D]D[( |T)[H]H:[M]M:[S]S[.DDDDDD]]
Minimum value: 0001-01-01 00:00:00
Maximum value: 9999-12-31 23:59:59.999999
Default precision 29, scale 9
FLOAT
Double
Precision 15, scale 0
INTEGER
BigInt
-9,223,372,036,854,775,808 to 9,223,372,036,854,775,807
Precision 19, scale 0
RECORD
String
1 to 104,857,600 characters
Default precision is 255. You can increase the value up to 104857600 characters.
NUMERIC
Decimal
  • For mappings:
    Default precision 28, scale 9.
    Maximum precision of 29.
    Range: -9.9999999999999999999999999999999999999E+29 to 9.9999999999999999999999999999999999999E+29
  • For mappings in advanced mode:
    Default precision 38, scale 9. For hierarchical data types, only up to a precision of 28 digits is applicable.
    You cannot use the decimal data type for hierarchical data in advanced mode.
    Range: -9.9999999999999999999999999999999999999E+28 to 9.9999999999999999999999999999999999999E+28
STRING
String
1 to 104,857,600 characters
Default precision is 255. You can increase the value up to 104,857,600 characters.
If you configure the optional connection property
SupportParameterisedDatatype
, you can use the string column precision that is defined in Google BigQuery when you import the metadata. However, if the precision defined in Google BigQuery is higher than 104,857,600 characters, then the precision is updated to 104,857,600 characters.
BYTE
Bytes
1 to 104,857,600 bytes
TIME¹
Date/Time
Time values. Google BigQuery Connector uses the following format:
[H]H:[M]M:[S]S[.DDDDDD]
Minimum value: 00:00:00
Maximum value: 23:59:59.999999
Precision 29, scale 9
TIMESTAMP¹
Date/Time
Google BigQuery Connector uses the following format:
YYYY-[M]M-[D]D[( |T)[H]H:[M]M:[S]S[.DDDDDD]][time zone]
Minimum value: 0001-01-01 00:00:00
Maximum value: 9999-12-31 23:59:59.999999 UTC
Precision 29, scale 9
INT64²
BigInt
-9,223,372,036,854,775,808 to 9,223,372,036,854,775,807
Precision 19, scale 0
FLOAT64²
Double
Precision 15, scale 0
BOOL²
String
Boolean True or False values.
Default precision is 5.
¹where
  • YYYY
    represents four-digit year
  • [M]M
    represents one or two digit month
  • [D]D
    represents one or two digit day
  • ( |T)
    represents a space or a
    T
    separator
  • [H]H
    represents one or two digit hour (valid values from 00 to 23)
  • [M]M
    represents one or two digit minutes (valid values from 00 to 59)
  • [S]S
    represents one or two digit seconds (valid values from 00 to 59)
  • [.DDDDDD]
    : represents microseconds up to six fractional digits.
  • [time zone]
    represents the time zone. Default time zone is UTC. Other time zones are not applicable.
²Applies only to SQL transformation.

0 COMMENTS

We’d like to hear from you!