Developer Mapping Guide

10.5.4
- 10.5.7
- 10.5.6
- 10.5
- 10.4.0

Back Next

Dynamic Sources

A dynamic source is a source that can change at run time. You can configure flat file, relational, Amazon S3, Amazon Redshift, HBase, HDFS, Microsoft Azure Blob Storage, Microsoft Azure Data Lake Store and complex file dynamic sources in a mapping.

You can configure dynamic run-time functionality for a source in the following ways:

Get columns from the data source.: When you expect small changes to a source at run time, you can configure the Read transformation to get flat file or relational object columns at run time. You can update the ports in a Read transformation at run time based on the structure of the relational data source or the flat file data source.
Assign a parameter to determine the flat file name and directory of source.: When the flat file sources are similar, you can assign a parameter to a file name or directory. When you use a parameter, you do not need to create a data object for each source.
Assign a parameter to determine the resource, table owner, or directory of a relational data object.: When the relational sources are similar, you can assign a parameter to get the resource, connection, and table owner properties.
Assign a parameter to determine the data object to use for a file or relational source.: When you expect small changes to a source, you can update the ports in a Read transformation at run time based on the structure of the relational data source or the flat file data source.

The following table shows where you can configure the dynamic run-time functionality of a source:

Dynamic Run-time Source Functionality	Configuration
Get columns from the data source.	Configure the Data Object tab on the Read transformation for the following source types: Flat file Relational Amazon Redshift Amazon S3 Microsoft Azure Blob Storage Microsoft Azure Data Lake Store HBase HDFS Snowflake
Assign a parameter to determine the flat file name and directory.	Configure the Advanced tab on the physical data object for the following source types: Flat file Amazon Redshift Amazon S3 Microsoft Azure Blob Storage Microsoft Azure Data Lake Store HDFS HBase Snowflake
Assign a parameter to determine the connection, owner, or resource.	Configure the Run-Time tab on the Read transformation for the following source types: Relational Amazon Redshift Amazon S3 Snowflake
Assign a parameter to determine the data object.	Configure the Data Object tab on the Read transformation for the following source types: Flat file Relational Amazon Redshift Amazon S3 HDFS Snowflake