Release Notes

Back Next

Amazon S3 V2 Connector

The tables in this section describe recent fixed issues for Amazon S3 V2 connector in

Metadata Command Center

. Not all monthly releases include fixed issues.

November 2024 EBF 2.25 fixed issues: Issue
Description

SCAN-14758
If you run a catalog source job to extract incremental metadata with partition pruning, the job doesn't consider partition pruning and considers only the changed and new folders since the last job run.
November 2024 fixed issues: Issue
Description

CDGC-73163
After you upgrade to the November 2024 release, if the first job you run on existing catalog sources is an incremental metadata extraction job, the job fails with the following error:
Running Incremental scan is not possible without last successful scan date provided.
August 2024 fixed issues: Issue
Description

CDGC-65381

Data profiling tasks on Amazon S3 Parquet files fail with the following error:
java.lang.RuntimeException: Either the Amazon S3 bucket bucket-gcs does not exist or the user does not have permission to access the bucket.

This issue occurs if you configure the staging connection for data profiling and the Amazon S3 account uses S3 compatible storage.

Issue	Description
SCAN-14758	If you run a catalog source job to extract incremental metadata with partition pruning, the job doesn't consider partition pruning and considers only the changed and new folders since the last job run.

Issue	Description
CDGC-73163	After you upgrade to the November 2024 release, if the first job you run on existing catalog sources is an incremental metadata extraction job, the job fails with the following error: Running Incremental scan is not possible without last successful scan date provided.

Issue	Description
CDGC-65381	Data profiling tasks on Amazon S3 Parquet files fail with the following error: java.lang.RuntimeException: Either the Amazon S3 bucket bucket-gcs does not exist or the user does not have permission to access the bucket. This issue occurs if you configure the staging connection for data profiling and the Amazon S3 account uses S3 compatible storage.

The tables in this section describe recent known issues for Amazon S3 V2 connector in

Metadata Command Center

. Not all monthly releases include known issues.

April 2025: Issue
Description

MDP-7690
When you use an asterisk wildcard in a data profiling filter on Amazon S3 catalog sources, the following issues occur:
Filters are not case sensitive.
The pattern '*' for folder names includes all files.
The pattern '/*/' for file names includes or excludes all files located more than one level under the parent folder.