Data Integration Connectors
- Data Integration Connectors
- All Products
Property
| Description
|
---|---|
Connection | Name of the source connection.
You can select an existing connection, create a new connection, or define parameter values for the source connection property.
If you want to overwrite the source connection properties at run time, select the
Allow parameter to be overridden at run time option.
|
Source Type | Type of the Open Table source object.
You can choose from the following source types:
|
Parameter
| A parameter file where you define values that you want to update without the need to edit the task.
Select an existing parameter for the source object or click
New Parameter to define a new parameter for the source object. The
Parameter property appears only if you select parameter as the source type.
If you want to overwrite the parameter at run time, select the
Allow parameter to be overridden at run time option.
When the task runs, the Secure Agent uses the parameters from the file that you specify in the advanced session properties.
|
Object | Source object for the mapping.
|
Property
| Description
|
---|---|
Filter
| Filter value in a read operation. Click
Configure to add conditions to filter records and reduce the number of rows that the Secure Agent reads from the source.
You can specify the following filter conditions:
|
Sort
| Not applicable
|
Property | Description |
---|---|
Iceberg Spark Properties | The properties that you want to configure for the Iceberg tables.
Enter the properties in the following
format: <parameter name>=<parameter
value> If you enter more than one
property, enter each property in a new line. For
example, s3.access-points.<bucket
name>=<S3 bucket
ARN> BucketRegion=<bucket-region-name> The S3 bucket ARN
property is mandatory when the source and target are in
different regions. For more information, see the Create the ARN for your AWS
S3 bucket KB article. |
Delta Spark Properties | The properties that you want to configure for the Delta Lake tables.
Enter the properties in the following
format: <parameter name>=<parameter
value> If you enter more than one
property, enter each property in a new line. For
example, BucketRegion=<bucket-region-name> |
Tracing Level | Sets the amount of detail that appears in the log file. You can choose terse, normal, verbose initialization, or verbose
data. Default is normal. |