Property | Description |
---|---|
Connection | Name of the Google Cloud Storage V2 target
connection. Select a source connection, or click New
Parameter to define a new parameter for the source
connection. If you want to overwrite the parameter at runtime,
select the Allow parameter to be overridden at run
time option when you create a parameter. When
the task runs, the agent uses the parameters from the file that
you specify in the task advanced session properties.
|
Target Type | Type of the Google Cloud Storage target objects
available. You can write data to a single target object or
parameterize Google Cloud Storage target object. You cannot write
data to multiple objects. |
Object | Name of the Google Cloud Storage file. Ensure that the
column names in the target object do not begin with special
characters to successfully write data to the target.
|
Parameter | Select an existing parameter for the target
object or click New Parameter to define a new
parameter for the target object. The
Parameter property appears only if you
select Parameter as the target type. If you want to overwrite
the parameter at runtime, select the Allow parameter
to be overridden at run time option when you
create a parameter. When the task runs, the agent uses the
parameters from the file that you specify in the task advanced
session properties.
|
Create New at Runtime | Creates a target. Enter a name and path for
the target object and select the source fields that you want to
use. By default, all source fields are used. The target name can contain alphanumeric characters. You can use
the following special characters in the file name: ., _,
@, $, %
If you specify the path, the Secure Agent creates the target
object in the path you specify in this property. The Secure
Agent creates the target object in the following path: <bucket_name>/<path_name>/<target_object_name>
You cannot parameterize the target at runtime. When you create a mapping in advanced mode, you can use the
CreateTarget option only for Avro,
JSON, and Parquet format. |
Format | Specifies the file format that the Google Cloud
Storage V2 Connector uses to write data to Google Cloud Storage.
You can select the following file format types:
If you select
None is as the format type, Google
Cloud Storage V2 Connector writes data to Google Cloud Storage
files in binary format. Open the Formatting Options dialog box to
configure the formatting options for the file. For more information about format options, see Google Cloud Storage file formatting options.
|
Operation | Select Insert as the
target operation. You cannot perform update, upsert, or delete
operations on a Google Cloud Storage object. |
¹ Applies only to mappings in advanced mode. ² Doesn't apply to mappings in advanced mode. |
Property | Description |
---|---|
Google Cloud Storage Path | Overrides the Google Cloud Storage path where the target file
exists. Use the following format: gs://<bucket
name> or gs://<bucket
name>/<folder name>
For example, gs://dlake_bkt/customer/sales
You cannot
specify wildcard characters in the Google Cloud Storage
path. |
Target File Name | Optional. Overrides the Google Cloud Storage
target object name specified in the Target transformation. |
Encryption Type | Method to encrypt data. You can select one of
the following encryption types:
Default is None . |
Compression Format 1
| Compresses data when you write to Google Cloud
Storage. You can compress the data in the following formats:
Default is None . In advanced mode, you can compress data only when you run a
mapping that writes data to a Google Cloud Storage file in
Parquet, JSON, or Delimited file formats. |
Use Parallel Composite Upload | Optimizes the upload of large files to Google Cloud Storage using the
Parallel Composite Upload strategy. In this strategy, a file is
divided into smaller chunks that are uploaded in parallel as
temporary objects. The final object is then reassembled from
these temporary objects, which are subsequently
deleted. Default is not selected. |
Forward Rejected Rows | This property is not applicable for Google Cloud
Storage V2 Connector. |
¹Applies only to mappings in advanced mode. |