Data Engineering Streaming
- Data Engineering Streaming 10.2.2
- All Products
Property
| Description
|
---|---|
Operation Type
| Indicates the type of data object operation.
This is a read-only property.
|
File Directory
| The location of the complex file target.
At run time, the Data Integration Service creates temporary directories in the specified file directory to manage the target files.
If the directory is in HDFS, enter the path without the node URI. For example,
/user/lib/testdir specifies the location of a directory in HDFS. The path must be 512 characters or less.
|
Overwrite Target
| Streaming mappings do not support this property.
|
File Name
| The name of the output file. Spark appends the file name with a unique identifier before it writes the file to HDFS.
|
File Format
| The file format. Select one of the following file formats:
|
Output Format
| The class name for files of the output format. If you select Output Format in the
File Format field, you must specify the fully qualified class name implementing the
OutputFormat interface.
|
Output Key Class
| The class name for the output key. By default, the output key class is NullWritable.
|
Output Value Class
| The class name for the output value. By default, the output value class is Text.
|
Compression Format
| Optional. The compression format for binary files. Select one of the following options:
|
Custom Compression Codec
| Required for custom compression. Specify the fully qualified class name implementing the
CompressionCodec interface.
|
Sequence File Compression Type
| Optional. The compression format for sequence files. Select one of the following options:
|