Amazon Athena Connector

Back Next

Amazon Athena sources in mappings

In a mapping, you can configure a Source transformation to represent an Amazon Athena source.

The following table describes the Amazon Athena source properties that you can configure in a Source transformation:

Property	Description
Connection	Name of the source connection. Select a source connection, or click New Parameter to define a parameter for the source connection.
Source type	Type of the source object. Select any of the following source object types: Single Object. Select to specify a single Amazon Athena object. Query. When you select the source type as query, you must map all the fields selected in the query in the Field Mapping tab. Parameter. Select to specify a parameter name.
Object	Name of the source object. Select a single source object.

When you preview a column in a table that uses binary data type, the column displays blank values.

The following table describes the query options that you can configure in a Source transformation:

Property	Description
Filter	Filter value in a read operation. Click Configure to add conditions to filter records and reduce the number of rows that the Secure Agent reads from the source. You can specify the following filter conditions: Not parameterized . Use a basic filter to specify the object, field, operator, and value to read specific records. Completely parameterized . Use a parameter to represent the filter conditions. Advanced . Use an advanced filter to define a complex filter condition.
Sort	Conditions to sort records. You can specify the following sort conditions: Not parameterized. Select the fields and type of sorting to use. Parameterized. Use a parameter to specify the sort condition. Sort Order. Specify whether you want to sort data in ascending or descending order.

Property

Description

Filter

Filter value in a read operation. Click

Configure

to add conditions to filter records and reduce the number of rows that the Secure Agent reads from the source.

You can specify the following filter conditions:

Not parameterized
. Use a basic filter to specify the object, field, operator, and value to read specific records.

Completely parameterized
. Use a parameter to represent the filter conditions.

Advanced
. Use an advanced filter to define a complex filter condition.

Sort

Conditions to sort records.

You can specify the following sort conditions:

Not parameterized.
Select the fields and type of sorting to use.

Parameterized.
Use a parameter to specify the sort condition.

Sort Order.
Specify whether you want to sort data in ascending or descending order.

When you configure an advanced filter on a Timestamp column, you must specify the value as

TIMESTAMP

in the filter condition. For example,

SELECT * FROM <dbname>.<tablename> where col_date < TIMESTAMP '2030-06-22 18:30:00.000';

The following table describes the Amazon Athena advanced source properties that you can configure in a Source transformation:

Property	Description
Retain Athena Query Result On S3 File	Specifies whether you want to retain the Amazon Athena query result on the Amazon S3 file. Select the check box to retain the Amazon Athena query result on the Amazon S3 file. The Amazon Athena query result in stored in the CSV file format. By default, the Retain Athena Query Result on S3 File check box is not selected.
S3OutputLocation	Specifies the location of the Amazon S3 file that stores the result of the Amazon Athena query. You can also specify the Amazon S3 file location in the S3OutputLocation parameter in the JDBC URL connection property. If you specify the Amazon S3 output location in both the connection and the advanced source properties, the Secure Agent uses the Amazon S3 output location specified in the advanced source properties.
Fetch Size	Determines the number of rows to read in one result set from Amazon Athena. Default is 10000.
Encryption Type	Encrypts the data in the Amazon S3 staging directory. You can select the following encryption types: None SSE-S3 SSE-KMS CSE-KMS Default is None.
Schema Name	Overrides the schema name of the source object.
Source Table Name	Overrides the table name used in the metadata import with the table name that you specify.
SQL Query	Overrides the default SQL query. Enclose column names in double quotes. The SQL query is case sensitive. Specify an SQL statement supported by the Amazon Athena database. When you specify the columns in the SQL query, ensure that the column name in the query matches the source column name in the mapping.

You can set the tracing level in the Amazon Athena advanced source properties to determine the amount of details that logs contain.

The following table describes the tracing levels that you can configure:

Tracing Level	Description
Terse	The Secure Agent logs initialization information, error messages, and notification of rejected data.
Normal	The Secure Agent logs initialization and status information, errors encountered, and skipped rows due to transformation row errors. Summarizes session results, but not at the level of individual rows.
Verbose Initialization	In addition to normal tracing, the Secure Agent logs additional initialization details, names of index and data files used, and detailed transformation statistics.
Verbose Data	In addition to verbose initialization tracing, the Secure Agent logs each row that passes into the mapping. Also notes where the Secure Agent truncates string data to fit the precision of a column and provides detailed transformation statistics. When you configure the tracing level to verbose data, the Secure Agent writes row data for all rows in a block when it processes a transformation.

Rename Saved Search

Table of Contents

Amazon Athena Connector

Amazon Athena Connector

Amazon Athena sources in mappings

Amazon Athena sources in mappings