When you run a mapping in the native environment, you can use wildcard characters in directory override or file name override.

When you run a mapping on the Spark or Databricks Spark engine, you can use wildcard character in directory override. You cannot use wildcard characters in file name override.

Ensure that the path specified in the directory override or file name override matches the file path in the source.

You cannot use wildcard characters when you read from partition columns.

When you run a mapping on the Spark or Databricks Spark engine and enable wildcard characters, ensure that the file name does not start with a special character.

When you read a complex file in a mapping, do not use a tilde (

~

) in the sub-directory name or file name.

When you run a mapping to read a flat file on the Spark or Databricks Spark engine, do not use the following special characters in the directory name or sub-directory name in the directory override:

When you use wildcard characters in directory override, the Data Integration Service reads data from the folders as well as the files that match the name pattern.