Data Profiling

Back Next

Source Mapplets

You can run a profiling task on the output from a source mapplet that you create in

Data Integration

. A source mapplet is a mapplet that has a source connection and a single output. You can also run a profiling task on a mapplet as a source object.

Before you use the mapplet as a source connection, make sure that source connections used in a mapplet are associated with an active Secure Agent.

The following image shows a source mapplet that has multiple source connections, transformations, and a mapplet output: The mapplet contains an Oracle source, SQL source, and real-time source. Multiple transformations read the sources and write the transformed data to a single output.

The mapplet contains an Oracle source, SQL source, and real-time source. Multiple transformations read the sources and write the transformed data to a single output.

Supported connections for source mapplets

You can run a profile on source mapplets that use the following connections:

Amazon Athena

Amazon Redshift

Amazon S3

Azure Data Lake Store

Databricks

Flat File

Google BigQuery

Google Cloud Storage

JDBC V2

MariaDB

Microsoft Azure Synapse

Microsoft Fabric OneLake

Microsoft SQL Server

MySQL

Oracle

ODBC

Oracle Object Source

PostgreSQL

Salesforce

SAP BW

SAP HANA

SAP Table

Snowflake

Supported transformations for source mapplets

You can run a profile on source mapplets that use the following transformations:

Aggregator

Expression

Filter

Joiner

Sorter

Union

Structure Parser

When you configure a Structure Parser transformation to profile semi-structured files, associate it with an intelligent structure model. Create a model based on a JSON or XML file.

An intelligent structure model is an asset that Intelligent Structure Discovery generates to represent the data that you expect the model to parse at run time. For more information, see Intelligent structure models.