Data Integration Connectors
- Data Integration Connectors
- All Products
Property | Description |
---|---|
Connection | Name of the target connection. You can select an existing connection, create a new connection,
or define parameter values for the source connection property. If you want to overwrite the target connection properties at run
time, select the Allow parameter to be overridden at
run time option. |
Target Type | Type of the Open Table target object. You can
choose from the following source types:
|
Parameter | A parameter file where you define values that you want to update
without having to edit the task. Select an existing parameter for the target object or click
New Parameter to define a new
parameter for the target object. The Parameter property appears only if you
select parameter as the target type. If you want to overwrite the target object at run time, select
the Allow parameter to be overridden at run
time option. When the task runs, the Secure Agent uses the parameters from the
file that you specify in the advanced session properties. |
Object | Name of the target object. You can select an
existing object from the list or create a target object at run
time. For information on creating the target object at run time,
see the Create a target table at runtime
topic. You cannot create a target object at runtime if you configure
Hive Metastore catalog in the connection. |
Operation | Type of the target operation. Select one of the following operations:
You cannot configure the Data Driven
operation on an Open Table target. |
Update Columns | Select the unique key column as the condition
field for the update, upsert, or delete operations in an Open Table
target. |
Property | Description |
---|---|
Iceberg Spark Properties | The properties that you want to configure for the Iceberg tables.
Enter the properties in the following
format: <parameter name>=<parameter
value> If you enter more than one
property, enter each property in a new line. For
example, BucketRegion=<bucket-region-name> When you configure update, upsert, or
delete target operations and the source and target are in
different regions, you need to set the bucket region
property. |
Delta Spark Properties | The properties that you want to configure for the Delta Lake tables.
Enter the properties in the following
format: <parameter name>=<parameter
value> If you enter more than one
property, enter each property in a new line. For
example, BucketRegion=<bucket-region-name> When the source and target are in
different regions, you need to set the bucket region
property. |
UpdateMode | Loads data to the target based on the mode you
specify. This property applies when you select the
Update or
Upsert operation.Select one of
the following modes:
|