Table of Contents

Search

  1. Preface
  2. Introduction to Test Data Management
  3. Test Data Manager
  4. Projects
  5. Policies
  6. Data Discovery
  7. Creating a Data Subset
  8. Performing a Data Masking Operation
  9. Data Masking Techniques and Parameters
  10. Data Generation
  11. Data Generation Techniques and Parameters
  12. Working with Test Data Warehouse
  13. Analyzing Test Data with Data Coverage
  14. Plans and Workflows
  15. Monitor
  16. Reports
  17. ilmcmd
  18. tdwcmd
  19. tdwquery
  20. Appendix A: Data Type Reference
  21. Appendix B: Data Type Reference for Test Data Warehouse
  22. Appendix C: Data Type Reference for Hadoop
  23. Appendix D: Glossary

User Guide

User Guide

Hive

Hive

The following table describes the supported Hive data types when the target is Hive or HDFS:
Data Types
Hive
HDFS
Comments
Bigint
Yes
Yes
Binary
Yes
No
You cannot perform data masking operations on Binary data types if you use a Spark execution engine to run a Hadoop plan.
Boolean
Yes
Yes
If the source contains True or False values, TDM populates the target with values 1 or 0.
Char
Yes
Yes
Date
Yes
Yes
Decimal
Yes
Yes
Double
Yes
Yes
Float
Yes
Yes
There is a data mismatch if the source contains the value 3.3 and the target contains the value 3.299999952316280.
Int
Yes
Yes
Smallint
Yes
Yes
String
Yes
Yes
Timestamp
Yes
Yes
Tinyint
Yes
Yes
Varchar
Yes
Yes
When the target is Hive or HDFS, TDM does not support the following Hive data types:
  • Array
  • Maps
  • Struct
When the source is a Hive connection, you cannot use a Hadoop HDFS target connection.

0 COMMENTS

We’d like to hear from you!