Microsoft Azure Data Lake Storage Gen2 Mapping Example
Microsoft Azure Data Lake Storage Gen2
Mapping Example
You work as a data analyst for a large financial enterprise. The enterprise performs risk management, fraud detection, and other analysis with Microsoft Azure Data Lake Analytics. You need to write the data to
Microsoft Azure Data Lake Storage Gen2
to perform the analytics. Create a mapping to read data from a flat file source and write data to
Microsoft Azure Data Lake Storage Gen2
. After the data is available in the
Microsoft Azure Data Lake Storage Gen2
, you can perform the data analytics.
You can use the following objects in a
Microsoft Azure Data Lake Storage Gen2
mapping:
Flat file input
The input file is a flat file that contains the customer names and other details about customers.
Create a flat file data object. Configure the flat file connection and specify the flat file that contains the customer data as a resource for the data object. Drag the data object into a mapping as a read data object.
Transformations
Add Filter transformation to get customer data in a particular region.
The Filter transformation filters the source data based on the value you specify for the region ID column. The Data Integration Service returns the rows that meet the filter condition.
Microsoft Azure Data Lake Storage Gen2
output
Create a
Microsoft Azure Data Lake Storage Gen2
data object write operation. Configure the
Microsoft Azure Data Lake Storage Gen2
connection and specify the
Microsoft Azure Data Lake Storage Gen2
object as a target for the data object. Drag the data object into a mapping as a target data object.
The following image shows the
Microsoft Azure Data Lake Storage Gen2
mapping example:
When you run the mapping, the customer records are read from the flat file and written to the