Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for HDFS
  3. PowerExchange for HDFS Configuration
  4. HDFS Connections
  5. HDFS Data Objects
  6. HDFS Data Extraction
  7. HDFS Data Load
  8. HDFS Mappings
  9. Appendix A: Data Type Reference

PowerExchange for HDFS User Guide

PowerExchange for HDFS User Guide

HDFS Data Objects Overview

HDFS Data Objects Overview

After you configure an HDFS connection, create a physical data object to read data from or write data to HDFS.
Depending on the file format, you can configure the following types of physical data objects:
  • Flat file data object. Create or import a flat file data object and configure an HDFS connection for the data object. Use the flat file data object to read or write fixed-width or delimited text files.
  • Complex file data object. Import a complex file data object with an HDFS connection. Use the complex file data object to read or write structured, semi-structured, unstructured data. For example, Avro, Parquet, Orc, XML, and JSON files have structured or semi-structured data. Binary files, such as PDF and Microsoft Word have unstructured data. Complex file data objects can also read intelligent structure sources.

0 COMMENTS

We’d like to hear from you!