Table of Contents

Search

  1. Preface
  2. Introduction to PowerExchange for Amazon S3
  3. PowerExchange for Amazon S3 Configuration Overview
  4. Amazon S3 Connections
  5. PowerExchange for Amazon S3 Data Objects
  6. PowerExchange for Amazon S3 Mappings
  7. PowerExchange for Amazon S3 Lookups
  8. Appendix A: Amazon S3 Data Type Reference
  9. Appendix B: Troubleshooting

PowerExchange for Amazon S3 User Guide

PowerExchange for Amazon S3 User Guide

Wildcard Characters for Reading Data from Complex Files

Wildcard Characters for Reading Data from Complex Files

When you run a mapping in the native environment or on the Spark and Databricks Spark engine to read data from an Avro, JSON, ORC, or Parquet file, you can use an asterisk (?) and (*) wildcard characters to specify the source file name.
You can use the following wildcard characters:
? (Question mark)
The question mark character (?) allows one occurrence of any character. For example, if you enter the source file name as
a?b.txt
, the Data Integration Service reads data from files with the following names:
  • a1b.txt
  • a2b.txt
  • aab.txt
  • acb.txt
* (Asterisk)
The asterisk mark character (*) allows zero or more than one occurrence of any character. If you enter the source file name as
a*b.txt
, the Data Integration Service reads data from files with the following names:
  • aab.txt
  • a1b.txt
  • ab.txt
  • abc11b.txt
When you read data from the Avro, JSON, ORC, or Parquet file that contains a colon (:) character in the file name, the mapping fails.

0 COMMENTS

We’d like to hear from you!