Table of Contents

Search

  1. Preface
  2. Introduction to Data Transformation
  3. Data Processor Transformation
  4. Wizard Input and Output Formats
  5. Relational Input and Output
  6. Using the IntelliScript Editor
  7. XMap
  8. Libraries
  9. Schema Object
  10. Command Line Interface
  11. Scripts
  12. Parsers
  13. Script Ports
  14. Document Processors
  15. Formats
  16. Data Holders
  17. Anchors
  18. Transformers
  19. Actions
  20. Serializers
  21. Mappers
  22. Locators, Keys, and Indexing
  23. Streamers
  24. Validators, Notifications, and Failure Handling
  25. Validation Rules
  26. Custom Script Components

Data Transformation User Guide

Data Transformation User Guide

Creating a Transformation with Parquet Input or Output

Creating a Transformation with Parquet Input or Output

Create a Data Processor transformation with Parquet input or output.
  1. In the Developer tool, click
    File
    New
    Transformation
    .
  2. Select the Data Processor transformation and click
    Next
    .
  3. Enter a name for the transformation and browse for a Model repository location to put the transformation.
  4. Select
    Create a data processor using a wizard
    and click
    Next
    .
  5. Select an input format and click
    Next
    .
  6. If you select Parquet as an input format, browse to select a Parquet schema or sample Parquet file. Click
    Next
    .
    The Developer tool adds a schema object file representing the Parquet hierarchy to the Model repository.
  7. Select an output format and click
    Next
    .
  8. If you select Parquet as an output format, browse to select a Parquet schema or sample Parquet file. Click
    Next
    .
    If you selected Parquet as the input format, you will not have the option to select Parquet as the output format.
  9. Click
    Finish
    .
    The Developer tool creates the transformation in the repository. The
    Overview
    view appears in the Developer tool.
  10. In the
    Objects
    view, double click the transformation component to open it in the IntelliScript editor.
    To configure the transformation component, add mapping statements.