Table of Contents

Search

  1. Preface
  2. Introduction to Google Cloud Storage V2 Connector
  3. Google Cloud Storage V2 connections
  4. Mappings for Google Cloud Storage
  5. Migrating a mapping
  6. Upgrading to Google Cloud Storage V2 Connector
  7. Appendix A: Data type reference

Google Cloud Storage V2 Connector

Google Cloud Storage V2 Connector

Google Cloud Storage V2 targets in mappings

Google Cloud Storage V2 targets in mappings

To write data to a Google Cloud Storage V2 target, configure a Google Cloud Storage object as the Target transformation in a mapping.
Specify the name and description of the Google Cloud Storage V2 target. You can configure the target and advanced properties for the target object.
The following table describes the properties that you can configure for a Google Cloud Storage V2 target:
Property
Description
Connection
Name of the Google Cloud Storage V2 target connection. Select a source connection, or click
New Parameter
to define a new parameter for the source connection.
If you want to overwrite the parameter at runtime, select the
Allow parameter to be overridden at run time
option when you create a parameter. When the task runs, the agent uses the parameters from the file that you specify in the task advanced session properties.
Target Type
Type of the Google Cloud Storage target objects available. You can write data to a single target object or parameterize Google Cloud Storage target object. You cannot write data to multiple objects.
Object
Name of the Google Cloud Storage file.
Ensure that the column names in the target object do not begin with special characters to successfully write data to the target.
Parameter
Select an existing parameter for the target object or click
New Parameter
to define a new parameter for the target object. The
Parameter
property appears only if you select Parameter as the target type.
If you want to overwrite the parameter at runtime, select the
Allow parameter to be overridden at run time
option when you create a parameter. When the task runs, the agent uses the parameters from the file that you specify in the task advanced session properties.
Create New at Runtime
Creates a target.
Enter a name and path for the target object and select the source fields that you want to use. By default, all source fields are used.
The target name can contain alphanumeric characters. You can use the following special characters in the file name:
., _, @, $, %
If you specify the path, the Secure Agent creates the target object in the path you specify in this property. The Secure Agent creates the target object in the following path:
<bucket_name>/<path_name>/<target_object_name>
You cannot parameterize the target at runtime.
When you create a mapping in advanced mode, you can use the
CreateTarget
option only for Avro, JSON, and Parquet format.
Format
Specifies the file format that the Google Cloud Storage V2 Connector uses to write data to Google Cloud Storage.
You can select the following file format types:
  • Flat
  • Avro
  • Parquet
  • JSON
  • Orc¹
  • None²
If you select
None
is as the format type, Google Cloud Storage V2 Connector writes data to Google Cloud Storage files in binary format.
Open the
Formatting Options
dialog box to configure the formatting options for the file.
For more information about format options, see Google Cloud Storage file formatting options.
Operation
Select
Insert
as the target operation. You cannot perform update, upsert, or delete operations on a Google Cloud Storage object.
¹ Applies only to mappings in advanced mode.
² Doesn't apply to mappings in advanced mode.
The following table describes the advanced properties that you can configure for a Google Cloud Storage V2 target:
Property
Description
Google Cloud Storage Path
Overrides the Google Cloud Storage path where the target file exists.
Use the following format:
gs://<bucket name>
or
gs://<bucket name>/<folder name>
For example,
gs://dlake_bkt/customer/sales
You cannot specify wildcard characters in the Google Cloud Storage path.
Target File Name
Optional. Overrides the Google Cloud Storage target object name specified in the Target transformation.
Encryption Type
Method to encrypt data.
You can select one of the following encryption types:
  • Informatica Encryption
  • None
Default is
None
.
Compression Format
1
Compresses data when you write to Google Cloud Storage.
You can compress the data in the following formats:
  • None
  • Gzip
  • Deflate
  • Snappy
Default is
None
.
In advanced mode, you can compress data only when you run a mapping that writes data to a Google Cloud Storage file in Parquet, JSON, or Delimited file formats.
Forward Rejected Rows
This property is not applicable for Google Cloud Storage V2 Connector.
¹Applies only to mappings in advanced mode.

0 COMMENTS

We’d like to hear from you!