Tuning the Hive Engine for Big Data Management®

Tuning the Hive Engine for Big Data Management®

Case Study: Port Precision

Case Study: Port Precision

This example demonstrates the performance benefits of configuring the correct precision setting for ports.

Expression Evaluation Mapping Before Optimization

The mapping reads data from an HDFS flat file, applies an expression to the data, and writes the results data to an HDFS flat file.
The mapping has a higher precision of 2000 for string ports but the actual source data being read from the file does not require larger port sizes.
The following image shows the columns with precision 2000 in the flat file source used in the mapping:

Expression Evaluation Mapping After Optimization

To tune the mapping, the port sizes for the String columns were reduced to a lower value.
The following image shows the columns with reduced precision in the flat file source used in the mapping:

Result

The mapping execution time reduced by 50%.

0 COMMENTS

We’d like to hear from you!