Table of Contents

Search

  1. Preface
  2. Data Profiling
  3. Profiles
  4. Profile results
  5. Tuning data profiling task performance
  6. Troubleshooting

Data Profiling

Data Profiling

Execution modes for Databricks Delta

Execution modes for Databricks Delta

You can run a profiling task on a Databricks Delta source on a Data Integration Server and on an advanced cluster.
The following table lists the functionalities available for each of the execution methods:
Functionality
Advanced Mode
Data Integration Server
Profiling on a Managed Databricks Delta table
YES
YES
Profiling on an External Databricks Delta table
YES
YES
Profiling on the view table
NO
YES
Data Preview
NO
YES
Simple Filter
NO
YES
Custom Query
NO
YES
SQL Override in the Advanced Options
NO
YES
FIRST N Rows
NO
YES
Drilldown
NO
YES
Query on profile results
NO
YES
Database Name or Table Name override in the Advanced Options
NO
YES
Ability to create a Databricks Delta source mapplet profile
NO
NO
Support of Data Quality Insight
NO
YES
Ability to create scorecard metrics
YES
YES
Compare Column
YES
YES
Compare Profile runs
YES
YES
Export/Import of Databricks profiles
YES
YES
Ability to link columns of files to Data Quality assets
YES
YES

0 COMMENTS

We’d like to hear from you!