Mass Ingestion Guide

10.4.0

Back Next

Hive Options

When you configure a transformation override for a Hive target, you can configure additional parameters to specify how the data is loaded to the Hive target tables.

The following image shows the dialog box that appears when you edit the properties for the Hive target table:

This image shows a dialog box to configure Hive options. Hive Options is selected.

The following table describes the Hive target table properties:

Property	Description
Hive Options	Select this option to configure the Hive target location.
DDL Query	Select this option to configure a custom DDL query that defines how data from the source tables is loaded to the target tables.
Storage Format	Required. The storage format of the target tables. You can select Text, Avro, Parquet, or ORC. Default is Text.
External Location	The external location of the Hive target. Enter an external location to specify a location other than the default Hive warehouse directory. A sub-directory is created under the specified external location for each source that is ingested. For example, you can enter /temp . A source table named PRODUCT is ingested to the external location /temp/PRODUCT/ .
Partition Key	The partition key for the target Hive table.
Clustered By	The cluster key for the target Hive table.
Number of buckets	Required if you specify a cluster key. The number of buckets to divide the target Hive table.

The following image shows the dialog box that appears when you edit the DDL query in the properties for the Hive target table:

This image shows a dialog box to configure Hive options. DDL Query is selected.

To edit the DDL query, use SQL statements and the following placeholders:

INFA_TABLE_NAME: Fetches the target table name at run time.
INFA_COLUMN_LIST: Fetches a list of columns in the target table at run time.

Rename Saved Search

Table of Contents

Mass Ingestion Guide

Mass Ingestion Guide

Hive Options

Hive Options