Table of Contents

Search

  1. Preface
  2. Introduction to Data Transformation
  3. Data Processor Transformation
  4. Wizard Input and Output Formats
  5. Relational Input and Output
  6. XMap
  7. Libraries
  8. Schema Object
  9. Command Line Interface
  10. Scripts
  11. Parsers
  12. Script Ports
  13. Document Processors
  14. Formats
  15. Data Holders
  16. Anchors
  17. Transformers
  18. Actions
  19. Serializers
  20. Mappers
  21. Locators, Keys, and Indexing
  22. Streamers
  23. Validators, Notifications, and Failure Handling
  24. Validation Rules
  25. Custom Script Components

Data Transformation User Guide

Data Transformation User Guide

Configure a Transformation with Avro Output

Configure a Transformation with Avro Output

To create a Data Processor transformation for Avro output, use the Data Processor transformation wizard. The wizard creates the transformation in the Model repository with the components you need to transform Avro output. Use the XMap editor to edit the XMap, if included. Add the transformation to a mapping with a complex file writer.
  1. Create the Data Processor transformation with the New Transformation wizard. Add an Avro schema or example file that defines the expect output structure.
  2. If the transformation has XML, JSON, or another structured format as input, use the XMap editor to edit and customize the XMap that the wizard created in the transformation.
  3. To configure the output settings for the Data Processor transformation, in the
    Output Control
    panel of the
    Settings
    view, select the relevant output option in the
    Binary output port collection mode
    area.
    To configure the output to send one record at a time with the schema, select the
    Output row for each row
    option. To collect all the records with the schema into one output stream, select the
    Collect input rows to a single output
    option.
  4. Add the Data Processor transformation to a mapping. The transformation remains set to binary output, the default setting for Avro output.
  5. Create and link a complex file writer to the Data Processor transformation in the mapping to receive the Avro output from the transformation.
    The input setting remains set to binary, the default setting. The complex file writer does not support compression for Avro output.