Big Data Management User Guide

Back Next

Parameter Usage

Use parameters for big data sources or target properties, connection properties, and run-time environment properties.

Big Data Sources and Targets

Hive sources: You can configure the following parameters for Hive Read transformation properties:
Connection. Configure this parameter on the
Run-time
tab.
Owner. Configure this parameter on the
Run-time
tab.
Resource. Configure this parameter on the
Run-time
tab.
Joiner queries. Configure this parameter on the
Query
tab.
Filter queries. Configure this parameter on the
Query
tab.
PreSQL commands. Configure this parameter on the
Advanced
tab.
PostSQL commands. Configure this parameter on the
Advanced
tab.
Constraints. Configure this parameter on the
Advanced
tab.
HBase sources and targets: You can configure the following parameters for HBase Read and Write transformation properties:
Connection. Configure this parameter on the
Overview
tab.
Date Time Format for the Read or Write data object. Configure this parameter on the
Advanced
tab.
Complex file sources and targets: You can configure the following parameters for complex file Read and Write transformation properties:
Connection. Configure this parameter on the
Overview
tab.
Data object read operation. Configure the following parameters on the
Advanced
tab:
File Path
File Format.
Input Format
Compression Format
Custom Compression Codec properties
Data object write operation. Configure the following parameters on the
Advanced
tab:
File Name
File Format
Output Format
Output Key Class
Output Value Class
Compression Format
Custom Compression Codec
Sequence File Compression Type
Flat file on HDFS sources and targets: You can configure the following parameters for a flat file on HDFS Read and Write transformation properties:
Data object read operation. Configure the following parameters on the
Run-time
tab:
Source File Name
Source File Directory
Data object write operation. Configure the following parameters on the
Run-time
tab:
Output File Directory
Output File Name