Table of Contents

Search

  1. Preface
  2. Introduction to Hive Connector
  3. Hive connections
  4. Mappings and mapping tasks with Hive Connector
  5. Migrating a mapping
  6. Data type reference
  7. Troubleshooting

Hive Connector

Hive Connector

Hive lookups in mappings

Hive lookups in mappings

You can create lookups for Hive objects. You can retrieve data from a Hive lookup object based on the specified lookup condition.
You can configure an unconnected with cached lookup in a Hive mapping. When you configure a lookup, you select the lookup connection and lookup object. You can define the behavior when a lookup condition returns more than one match.
The following table describes the Hive lookup object properties that you can configure in a Lookup transformation in mappings:
Property
Description
Connection
Name of the lookup connection.
You can select an existing connection, create a new connection, or define parameter values for the lookup connection property.
If you want to overwrite the lookup connection properties at runtime, select the
Allow parameter to be overridden at run time
option.
Source Type
Type of the source object. Select Single Object or Parameter.
Parameter
A parameter file where you define values that you want to update without having to edit the task.
Select an existing parameter for the lookup object or click
New Parameter
to define a new parameter for the lookup object.
The
Parameter
property appears only if you select parameter as the lookup type.
If you want to overwrite the parameter at runtime, select the
Allow parameter to be overridden at run time
option.
When the task runs, the Secure Agent uses the parameters from the file that you specify in the advanced session properties.
Lookup Object
Name of the lookup object for the mapping.
Multiple Matches
Behavior when the lookup condition returns multiple matches. You can return all rows, any row, or an error.
You can select from the following options in the lookup object properties to determine the behavior:
  • Return any row
  • Return all rows
  • Report error
The following table describes the Hive lookup object advanced properties that you can configure in a Lookup transformation in mappings:
Advanced Property
Description
SQL Override
When you read data from a Hive source object, you can configure SQL overrides and define constraints.
PreSQL
SQL statement that you want to run before reading data from the source.
PostSQL
SQL statement that you want to run after reading data from the source.

0 COMMENTS

We’d like to hear from you!