Google Cloud Storage V2 Connector

Back Next

Google Cloud Storage V2 sources in mappings

To read data from a Google Cloud Storage file, configure a Google Cloud Storage object as the Source transformation in a mapping.

Specify the name and description of the Google Cloud Storage source. Configure the source and advanced properties for the source object.

The following table describes the properties that you can configure for a Google Cloud Storage source:

Property	Description
Connection	Name of the Google Cloud Storage V2 connection. Select a source connection, or click New Parameter to define a new parameter for the source connection. If you want to overwrite the parameter at runtime, select the Allow parameter to be overridden at run time option when you create a parameter.
Source Type	Type of the Google Cloud Storage source object available. You can read data to a single Google Cloud Storage source object.
Object	Name of the source object for the mapping. Ensure that the column names in the source object do not begin with special characters to successfully read data from the source.
Parameter	A parameter file where you define values that you want to update without having to edit the task. Select a parameter for the source object, or click New Parameter to define a new parameter for the source object. The Parameter property appears only if you select Parameter as the source type. When you define the value for the source object parameter, ensure that you provide a valid file name. If you want to overwrite the parameter at runtime, select the Allow parameter to be overridden at run time option when you create a parameter. When the task runs, the agent uses the parameters from the file that you specify in the task advanced session properties.
Format	Specifies the file format that the Google Cloud Storage V2 Connector uses to read data from Google Cloud Storage. You can select the following file format types: Flat Avro Parquet JSON Orc¹ None² If you select None is as the format type, Google Cloud Storage V2 Connector reads data from Google Cloud Storage files in binary format. Open the Formatting Options dialog box to configure the formatting options for the file. For more information about format options, see Google Cloud Storage file formatting options.
Filter	This attribute is not applicable for Google Cloud Storage V2 Connector.
Sort	This attribute is not applicable for Google Cloud Storage V2 Connector.

¹ Applies only to mappings in advanced mode.

² Doesn't apply to mappings in advanced mode.

The following table describes the advanced properties that you can configure for a Google Cloud Storage source:

Property	Description
Google Cloud Storage Path	Optional. Overrides the bucket name or folder path of the Google Cloud Storage file that you specified in the connection. Use the following format: gs://<bucket name> or gs://<bucket name>/<folder name> For example, gs://dlake_bkt/customer/sales You cannot specify wildcard characters in the Google Cloud Storage path.
Source File Name	Optional. Overrides the Google Cloud Storage source file name that you specified in the Source transformation. Does not apply when you configure Is Directory option to read multiple files from a directory.
Is Directory	Select this property to read all the files available in the folder specified in the Google Cloud Storage Path property. If you do not provide the Google Cloud Storage Path value during run time, the Secure Agent considers the value of the Google Cloud Storage Path that you specify when you select a Google Cloud Storage source file in the Source transformation.
Incremental File Load¹	Indicates whether you want to incrementally load files when you use a directory as the source for mappings in advanced mode. When you incrementally load files, the mapping task reads and processes only files in the directory that have changed since the mapping task last ran. For more information, see Incrementally loading files for mappings in advanced mode.
Allow Wildcard Characters¹	Indicates whether you want to use wildcard characters for the directory sources. If you select this option, you can use the question mark (?) and asterisk (*) wildcard characters in the folder path or file name. For details, see Wildcard characters for mappings in advanced mode.
Encryption Type	Method to decrypt data. You can select one of the following encryption types: Informatica Encryption None Default is None .
Compression Format	Method to read compressed data from Google Cloud Storage. You can read the compressed data in the following formats: None Gzip Select None to read from the compressed Avro or Parquet file. Select Gzip to read from the compressed Flat file. Default is None .

¹Applies only to mappings in advanced mode.

You can set the tracing level in the advanced properties session to determine the amount of details that logs contain.

The following table describes the tracing levels that you can configure:

Tracing Level	Description
Terse	The Secure Agent logs initialization information, error messages, and notification of rejected data.
Normal	The Secure Agent logs initialization and status information, errors encountered, and skipped rows due to transformation row errors. Summarizes session results, but not at the level of individual rows.
Verbose Initialization	In addition to normal tracing, the Secure Agent logs additional initialization details, names of index and data files used, and detailed transformation statistics.
Verbose Data	In addition to verbose initialization tracing, the Secure Agent logs each row that passes into the mapping. Also notes where the Secure Agent truncates string data to fit the precision of a column and provides detailed transformation statistics. When you configure the tracing level to verbose data, the Secure Agent writes row data for all rows in a block when it processes a transformation.

Rename Saved Search

Table of Contents

Google Cloud Storage V2 Connector

Google Cloud Storage V2 Connector

Google Cloud Storage V2 sources in mappings

Google Cloud Storage V2 sources in mappings