Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for HDFS
  3. PowerExchange for HDFS Configuration
  4. HDFS Connections
  5. HDFS Data Objects
  6. HDFS Data Extraction
  7. HDFS Data Load
  8. HDFS Mappings
  9. Appendix A: Data Type Reference

PowerExchange for HDFS User Guide

PowerExchange for HDFS User Guide

HDFS or View File System (ViewFS) Data Extraction Overview

HDFS or View File System (ViewFS) Data Extraction Overview

You can use a flat file data object or a complex file data object to read data from HDFS or View File System (ViewFS).
Complete the following tasks to read data from HDFS or ViewFS by using PowerExchange for HDFS
:
  1. Create an HDFS or ViewFS connection.
  2. Create a flat file data object or a complex file data object. Specify the data object properties such as the file location, compression format, and input format.
  3. Create a mapping and use the flat file data object or the complex file data object read operation as a source.
  4. If needed, configure a Data Processor transformation to parse the complex file.
  5. Configure the validation and run-time environment type.
  6. Run the mapping to read data from HDFS or ViewFS.

0 COMMENTS

We’d like to hear from you!