English
  • Data Engineering Integration 10.2 HotFix 1
  • All Products

Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Connections
  4. Mappings in the Hadoop Environment
  5. Mapping Objects in the Hadoop Environment
  6. Processing Hierarchical Data on the Spark Engine
  7. Stateful Computing on the Spark Engine
  8. Monitoring Mappings in the Hadoop Environment
  9. Mappings in the Native Environment
  10. Profiles
  11. Native Environment Optimization
  12. Data Type Reference
  13. Complex File Data Object Properties
  14. Function Reference
  15. Parameter Reference

Big Data Management User Guide

Big Data Management User Guide

Back Next

Column Projection Properties

Column Projection Properties

The Developer tool displays the column projection properties for Avro, JSON, and Parquet complex file targets in the Properties view of the
Write
 operation.
The following table describes the advanced properties that you configure for Avro, JSON, and Parquet complex file targets:
Property
Description
Enable Column Projection
Displays the column details of the complex files sources.
Schema Format
Displays the schema format that you selected while creating the complex file data object. You can change the schema format and provide respective schema.
Schema
Displays the schema associated with the complex file. You can select a different schema.
If you disable the column projection, the schema associated with the complex file is removed. If you want to associate schema again with the complex file, enable the column projection and click Select Schema.
Column Mapping
Displays the mapping between input and output ports.
If you disable the column projection, the mapping between input and output ports is removed. If you want to map the input and output ports, enable the column projection and click Select Schema to associate a schema to the complex file.
Project Column as Complex Data Type
Displays columns with hierarchical data as a complex data type, such as, array, map, or struct. Select this property when you want to process hierarchical data on the Spark engine.
If you disable the column projection, the data type of the column is displayed as binary type.