Hi, I'm Ask INFA!
What would you like to know?
ASK INFAPreview
Please to access Ask INFA.

Table of Contents

Search

  1. Preface
  2. Introduction to Amazon S3 catalog sources
  3. Before you begin
  4. Create catalog sources in Metadata Command Center
  5. View results in Data Governance and Catalog
  6. Appendix A: Managing catalog sources

Amazon S3 Sources

Amazon S3 Sources

Data profiling for Amazon S3 objects

Data profiling for
Amazon S3
objects

Configure data profiling to run profiles on the metadata extracted from an
Amazon S3
source system. You can view the profiling statistics in
Data Governance and Catalog
.
You can run data profiles on the following objects:
  • Avro
  • CSV
  • JSON
  • Parquet
To run profiles on Avro, JSON, or Parquet files, connect to an advanced cluster.
For more information about advanced clusters, see
Advanced Clusters
in the Cloud Common Services help.
You can also run profiles on a Secure Agent installed on an Amazon EC2 instance on AWS that uses the Instance Metadata Service Version 2 (IMDSv2) method.
The data profiling task runs profiles on the following data types for Avro, CSV, JSON, and Parquet file formats:
File format
Data type
Avro
  • INT
  • STRING
CSV
  • STRING
JSON
  • ARRAY
  • DOUBLE
  • INTEGER
  • OBJECT
  • STRING
Parquet
  • BOOLEAN
  • INT32
  • INT64
  • FLOAT
  • DOUBLE
  • DATE
  • DECIMAL
  • STRING
Sampling type
You can run the data profiling task on all rows for an Amazon S3 source system.

0 COMMENTS

We’d like to hear from you!
Vivek Singh - May 01, 2025

JSON file also requires advanced cluster for profiling. Kindly check and update the documentation.

Informatica Documentation Team - May 05, 2025

Hello Vivek Singh,

We're working to address your comment and will get back to you.

Thanks, Informatica Documentation team


Informatica Documentation Team - May 16, 2025

Hello Vivek Singh,

We're glad to let you know that we have addressed your comment and added information on advanced clusters in Data profiling for Amazon S3 objects.

Thanks, Informatica Documentation team