Table of Contents

Search

  1. Preface
  2. Introduction to Informatica Big Data Management
  3. Connections
  4. Mappings in the Hadoop Environment
  5. Mapping Objects in the Hadoop Environment
  6. Processing Hierarchical Data on the Spark Engine
  7. Stateful Computing on the Spark Engine
  8. Monitoring Mappings in the Hadoop Environment
  9. Mappings in the Native Environment
  10. Profiles
  11. Native Environment Optimization
  12. Data Type Reference
  13. Complex File Data Object Properties
  14. Function Reference
  15. Parameter Reference

Parameterization of Complex File Data Objects

Parameterization of Complex File Data Objects

You can parameterize the complex file connection and the complex file data object operation properties.
You can parameterize the following data object read operation properties for complex data objects:
  • Connection in the run-time properties
  • File Format, Input Format, Compression Format, and Custom Compression Codec in the advanced properties.
You can parameterize the following data object write operation properties for complex file data objects:
  • Connection in the run-time properties.
  • File Name, Output Format, Output Key Class, Output Value Class, Compression Format, Custom Compression Codec, and Sequence File Compression Type in the advanced properties.
The following attributes support full and partial parameterization for complex file data objects:
  • File Path in the advanced properties of the data object read operation.
    For example, to parameterize a part of the attribute value where the file path in the advanced property is
    /user/adpqa/dynschema.txt
    , create a parameter as
    $str="/user/adpqa"
    , and then edit the file path as
    $str/dynschema.txt
    . You can also parameterize the value of the entire file path.
  • File Directory in the advanced properties of the data object write operation.
    For example, to parameterize a part of the attribute value where the file directory in the advanced property is
    /export/home/qamercury/source
    , create a parameter as
    $param="/export/home"
    , and then edit the file directory as
    $param/qamercury/source
    . You can also parameterize the value of the entire directory.


Updated December 13, 2018