You can read objects stored in subdirectories in Microsoft Azure Data Lake Storage Gen2 in the native environment, Spark engine, or Databricks Spark engine
You can use recursive read for flat files in the native environment, Spark engine, and Databricks Spark engine and for complex files only in the native environment.
To use recursive read, select the source type as
Directory
in the advanced read properties. Enable the
Recursive Directory Read
advanced read property to read objects stored in subdirectories.