Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for HDFS
  3. PowerExchange for HDFS Configuration
  4. HDFS Connections
  5. HDFS Data Objects
  6. HDFS Data Extraction
  7. HDFS Data Load
  8. HDFS Mappings
  9. Appendix A: Data Type Reference

PowerExchange for HDFS User Guide

PowerExchange for HDFS User Guide

Flat File Data Object Read Properties

Flat File Data Object Read Properties

The Data Integration Service uses read properties when it reads data from a flat file. You can edit the format and runtime read properties on the
Advanced
tab.
The following table describes the HDFS connection and compression run-time properties that you configure for flat file sources:
Property
Description
Connection Type
The type of connection. Select from the following options:
  • None. The source file does not require a connection.
  • Hadoop File System. The source file resides in HDFS.
Default is None.
Connection Name
The name of the connection. Select an HDFS connection or assign a mapping parameter that defines the connection details.
Compression Format
Optional. Specifies the compression format. Select from the following options:
  • None
  • Auto
  • Gzip
  • Bzip2
  • Lzo
  • Custom
Compression Codec
Required for custom compression. Specify the fully qualified class name implementing the Hadoop
CompressionCodec
interface.

0 COMMENTS

We’d like to hear from you!