Mass Ingestion Guide

10.5

Back Next

Configuring the Transformation Override

Optionally, configure the transformation override to override the parameters that are applied to specific source tables.

For some parameters, you can click the arrow next to the text box to select columns from a list of columns that exist in the table.

If you enabled incremental load in the definition of the mass ingestion specification, edit the incremental key column for a source table in the

Incremental Column

column.

In the

Filter By

column, edit the filter clause.

In the

Drop Columns

column, edit the list of columns or the regular expression.

In the

Trim

column, edit the list of columns or the regular expression.

In the

Convert to Uppercase

column, edit the list of columns or the regular expression.

In the

Convert to Lowercase

column, edit the list of columns or the regular expression.

In the

Replace Columns

column, click the pencil.

For

Replace

, edit the list of columns or the regular expression.

For

Replace Criteria

, select

Entire String

Pattern

If you select Entire String, edit the new string.

If you select Pattern, edit the previous string or pattern, or edit the new string.

If the target is a Hive target, click the pencil in the

Hive

column and choose one of the following options:

Select

Hive Options

and enter the partition key, the cluster key, and the number of buckets.

Select

DDL Query

and edit the custom DDL query.

Creating a Mass Ingestion Specification

Download Guide

Watch

Comments

Communities

Knowledge Base

Success Portal

0 COMMENTS

We’d like to hear from you! Log in to comment.

Rename Saved Search

Table of Contents

Mass Ingestion Guide

Mass Ingestion Guide

Configuring the Transformation Override

Configuring the Transformation Override