Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Microsoft Azure Data Lake Storage Gen2
  3. PowerExchange for Microsoft Azure Data Lake Storage Gen2 Configuration
  4. Microsoft Azure Data Lake Storage Gen2 Connections
  5. PowerExchange for Microsoft Azure Data Lake Storage Gen2 Data Objects
  6. Microsoft Azure Data Lake Storage Gen2 Mappings
  7. Appendix A: Microsoft Azure Data Lake Storage Gen2 Datatype Reference

PowerExchange for Microsoft Azure Data Lake Storage Gen2 User Guide

PowerExchange for Microsoft Azure Data Lake Storage Gen2 User Guide

Microsoft Azure Data Lake Storage Gen2 Mapping Example

Microsoft Azure Data Lake Storage Gen2
Mapping Example

You work as a data analyst for a large financial enterprise. The enterprise performs risk management, fraud detection, and other analysis with Microsoft Azure Data Lake Analytics. You need to write the data to
Microsoft Azure Data Lake Storage Gen2
to perform the analytics. Create a mapping to read data from a flat file source and write data to
Microsoft Azure Data Lake Storage Gen2
. After the data is available in the
Microsoft Azure Data Lake Storage Gen2
, you can perform the data analytics.
You can use the following objects in a
Microsoft Azure Data Lake Storage Gen2
mapping:
Flat file input
The input file is a flat file that contains the customer names and other details about customers.
Create a flat file data object. Configure the flat file connection and specify the flat file that contains the customer data as a resource for the data object. Drag the data object into a mapping as a read data object.
Transformations
Add Filter transformation to get customer data in a particular region.
The Filter transformation filters the source data based on the value you specify for the region ID column. The Data Integration Service returns the rows that meet the filter condition.
Microsoft Azure Data Lake Storage Gen2
output
Create a
Microsoft Azure Data Lake Storage Gen2
data object write operation. Configure the
Microsoft Azure Data Lake Storage Gen2
connection and specify the
Microsoft Azure Data Lake Storage Gen2
object as a target for the data object. Drag the data object into a mapping as a target data object.
The following image shows the
Microsoft Azure Data Lake Storage Gen2
mapping example:
You can view the mapping that reads from the flat file object and writes to the Microsoft Azure Data Lake Store object, ADOO_load_customer.
When you run the mapping, the customer records are read from the flat file and written to the
Microsoft Azure Data Lake Storage Gen2
file.

0 COMMENTS

We’d like to hear from you!