Table of Contents

Search

  1. Preface
  2. Introduction to Test Data Management
  3. Test Data Manager
  4. Projects
  5. Policies
  6. Data Discovery
  7. Data Subset
  8. Data Masking
  9. Data Masking Techniques and Parameters
  10. Data Generation
  11. Data Generation Techniques and Parameters
  12. Working with Test Data Warehouse
  13. Analyzing Test Data with Data Coverage
  14. Plans and Workflows
  15. Monitor
  16. Reports
  17. ilmcmd
  18. tdwcmd
  19. tdwquery
  20. Data Type Reference
  21. Data Type Reference for Test Data Warehouse
  22. Data Type Reference for Hadoop
  23. Glossary

Creating a Hadoop Plan

Creating a Hadoop Plan

To perform data movement and data masking operations for Hadoop connections, you can create a Hadoop plan. Add groups and data masking components to a Hadoop plan. You cannot perform data subset or data generation operations for Hadoop sources and targets.
  1. Open a project and click
    Execute
    .
  2. Click
    Actions
    New
    .
  3. In the
    New Plan
    dialog box, enter a name and optional description for the plan.
  4. Select
    Hadoop
    plan type.
  5. Click
    Next
    .
  6. To add a data masking operation to the plan, click
    Add Masking Components
    .
  7. Select the policies and rules to add to the plan. Click
    OK
    .
  8. Click
    Next
    .
  9. To add groups to the plan, click
    Add Groups
    . You can add groups to a plan to move data from a source to a target.
  10. Select the groups to add to the plan. Click
    OK
    .
  11. Click
    Next
    .
  12. Review all the masking components and groups.
    You cannot edit the groups.
  13. Click
    Next
    .
  14. Configure source and target connections.
  15. If you select an HDFS target connection, you can choose to select the resource format. Select Avro or Parquet. Default is None.
  16. Configure target properties and error and recovery settings.
  17. Configure advanced settings. You can choose to persist mapping to store mappings for future use. You can select Hive or Blaze execution engine.
  18. Click
    Next
    .
  19. To override plan settings, click
    Override Plan Settings
    and enter the properties.
  20. To override table settings, click
    Override Data Source Settings
    and enter the properties.
  21. Click
    Finish
    .