Data Engineering Integration
All Products
Property
| Description
|
---|---|
File Directory
| The directory location of the complex file target.
If the directory is in HDFS, enter the path without the node URI. For example,
/user/lib/testdir specifies the location of a directory in HDFS. The path must not contain more than 512 characters.
If the directory is in the local system, enter the fully qualified path. For example,
/user/testdir specifies the location of a directory in the local system.
The Data Integration Service ignores any subdirectories and their contents.
|
File Name
| The name of the output file. PowerExchange for HDFS appends the file name with a unique identifier before it writes the file to HDFS.
|
File Format
| The file format. Select one of the following file formats:
Default is Binary.
|
Output Format
| The class name for files of the output format. If you select Output Format in the
File Format
field, you must specify the fully qualified class name implementing the
OutputFormat interface.
|
Output Key Class
| The class name for the output key. If you select Output Format in the
File Format
field, you must specify the fully qualified class name for the output key.
You can specify one of the following output key classes:
PowerExchange for HDFS generates the key in ascending order.
|
Output Value Class
| The class name for the output value. If you select Output Format in the
File Format
field, you must specify the fully qualified class name for the output value.
You can use any custom writable class that Hadoop supports. Determine the output value class based on the type of data that you want to write.
When you use custom output formats, the value part of the data that is streamed to the complex file data object write operation must be in a serialized form.
|
Compression Format
| Optional. The compression format for binary files. Select one of the following options:
|
Custom Compression Codec
| Required for custom compression. Specify the fully qualified class name implementing the
CompressionCodec interface.
|
Sequence File Compression Type
| Optional. The compression format for sequence files. Select one of the following options:
|
Updated December 13, 2018