Cloud Data Integration Connectors Current Version
- Cloud Data Integration Connectors Current Version
- All Products
Name of the source connection. Select a source connection, or click
New Parameterto define a parameter for the source connection.
Type of the source object.
Select any of the following source object types:
Name of the source object.
Select a single source object.
Filter value in a read operation. Click
Configureto add conditions to filter records and reduce the number of rows that the Secure Agent reads from the source.
You can specify the following filter conditions:
Conditions to sort records.
You can specify the following sort conditions:
Retain Athena Query Result On S3 File
Specifies whether you want to retain the Amazon Athena query result on the Amazon S3 file. Select the check box to retain the Amazon Athena query result on the Amazon S3 file.
The Amazon Athena query result in stored in the CSV file format.
By default, the
Retain Athena Query Result on S3 Filecheck box is not selected.
Specifies the location of the Amazon S3 file that stores the result of the Amazon Athena query.
You can also specify the Amazon S3 file location in the
S3OutputLocationparameter in the
JDBC URLconnection property.
If you specify the Amazon S3 output location in both the connection and the advanced source properties, the Secure Agent uses the Amazon S3 output location specified in the advanced source properties.
Determines the number of rows to read in one result set from Amazon Athena.
Default is 10000.
Encrypts the data in the Amazon S3 staging directory.
You can select the following encryption types:
Default is None.
Overrides the schema name of the source object.
Source Table Name
Overrides the table name used in the metadata import with the table name that you specify.
The Secure Agent logs initialization information, error messages, and notification of rejected data.
The Secure Agent logs initialization and status information, errors encountered, and skipped rows due to transformation row errors. Summarizes session results, but not at the level of individual rows.
In addition to normal tracing, the Secure Agent logs additional initialization details, names of index and data files used, and detailed transformation statistics.
In addition to verbose initialization tracing, the Secure Agent logs each row that passes into the mapping. Also notes where the Secure Agent truncates string data to fit the precision of a column and provides detailed transformation statistics.
When you configure the tracing level to verbose data, the Secure Agent writes row data for all rows in a block when it processes a transformation.