Table of Contents

Search

  1. Preface
  2. Introduction to Test Data Management
  3. Test Data Manager
  4. Projects
  5. Policies
  6. Data Discovery
  7. Creating a Data Subset
  8. Performing a Data Masking Operation
  9. Data Masking Techniques and Parameters
  10. Plans and Workflows
  11. Monitor
  12. Reports
  13. ilmcmd
  14. Data Type Reference
  15. Data Type Reference for Hadoop

Hive

Hive

The following table describes the supported Hive data types when the target is Hive or HDFS:
Data Types
Hive
HDFS
Comments
Bigint
Yes
Yes
Binary
Yes
No
You cannot perform data masking operations on Binary data types if you use a Spark execution engine to run a Hadoop plan.
Boolean
Yes
Yes
If the source contains True or False values, TDM populates the target with values 1 or 0.
Decimal
Yes
Yes
Double
Yes
Yes
Float
Yes
Yes
There is a data mismatch if the source contains the value 3.3 and the target contains the value 3.299999952316280.
Int
Yes
Yes
Smallint
Yes
Yes
String
Yes
Yes
Tinyint
Yes
Yes
When the target is Hive or HDFS, TDM does not support the following Hive data types:
  • Array
  • Char
  • Date
  • Maps
  • Struct
  • Timestamp
  • Varchar