Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for HDFS
  3. PowerExchange for HDFS Configuration
  4. HDFS Connections
  5. HDFS Data Objects
  6. HDFS Data Extraction
  7. HDFS Data Load
  8. HDFS Mappings
  9. Appendix A: Data Type Reference

PowerExchange for HDFS User Guide

PowerExchange for HDFS User Guide

Working with FileName Port

Working with FileName Port

You can use the FileName port in a complex file target to dynamically redirect the rows based on the value received by FileName port.
When you run a mapping in the native environment to read or write a flat file using the FileName port, the Data Integration Service creates separate directories for each value in the FileName port in the following format:
<CFW FileName>/<CFW FileName>=<valueFromMappingFlow>
When you run a mapping in the native environment or on the Spark engine to read or write an Avro, JSON, ORC, Parquet or Binary(Native) file using the FileName port, the Data Integration Service creates separate directories for each value in the FileName port and adds the files within the directories.

0 COMMENTS

We’d like to hear from you!