Microsoft Azure Data Lake Storage Gen2 Connector

Back Next

Mappings in advanced mode example

You work for one of the largest community college that maintains millions of records in their ongoing student database. The college has more than 10,000 faculty members teaching at 45 campuses and 700 locations across the globe. The college has a very large IT infrastructure and about 15 TB of information gets downloaded on daily basis from the Internet.

To avoid performance, scalability, and high cost challenges, the college plans to port its entire data from its operational data stores to

Microsoft Azure Data Lake Storage Gen2

within a short span of time. Configure a mapping in advanced mode to achieve faster performance when you read data from the operational data stores and write data to the

Microsoft Azure Data Lake Storage Gen2

target.

In Data Integration, click

New

Mappings

Mapping

In the Mapping Designer, click

Switch to Advanced

The following image shows the

Switch to Advanced

button in the Mapping Designer:

In the

Switch to Advanced

dialog box, click

Switch to Advanced

The Mapping Designer updates the mapping canvas to display the transformations and functions that are available in advanced mode.

Enter a name, location, and description for the mapping.

On the Source transformation, specify a name and description in the general properties.

On the

Source

tab, perform the following steps to provide the source details to read data from the source:

In the

Connection

field, select the required source connection.

In the

Source Type

field, select the type of the source.

In the

Object

field, select the required object.

In the

Advanced Properties

section, provide the appropriate values.

When you read a flat file, ensure that the file has a header row. Else, the Secure Agent fails to read the first row.

On the

Fields

tab, map the source fields to the target fields.

On the Target transformation, specify a name and description in the general properties.

On the

Target

tab, perform the following steps to provide the target details to write data to the

Microsoft Azure Data Lake Storage Gen2

target:

In the

Connection

field, select the

Microsoft Azure Data Lake Storage Gen2

target connection.

In the

Target Type

field, select the type of the target.

In the

Object

field, select the required object.

In the

Operation

field, select the required operation.

In the

Advanced Properties

section, provide appropriate values for the advanced target properties.

Map the source and target.

Click

Save

Run

to validate the mapping.

In Monitor, you can monitor the status of the logs after you run the task.

Mappings for Microsoft Azure Data Lake Storage Gen2

Download Guide

Watch

Comments

Cloud Connectivity Homepage

Communities

Knowledge Base

Success Portal

0 COMMENTS

We’d like to hear from you! Log in to comment.

Rename Saved Search

Table of Contents

Microsoft Azure Data Lake Storage Gen2 Connector

Microsoft Azure Data Lake Storage Gen2 Connector

Mappings in advanced mode example

Mappings in advanced mode example